Releases | Open Source Science

https://github.com/argoeu/argo-connectors - Version 2.3.1

Changed

ARGO-5029 Provider connector should complain and stop if access token could not be fetched from refresh token

Added

ARGO-5013 LOT1 Service Catalogue connector
ARGO-5035 Provider connector need to handle OIDC refresh token rotation

- Python
Published by themiszamani 11 months ago

https://github.com/argoeu/argo-connectors - Version 2.3.0

Fixed

ARGO-4440 Contactfeed test fix
ARGO-4817 Fix log message write in separate logfile

Changed

ARGO-4556 argo-connectors wheel packing and Poetry dependency handling
ARGO-4690 Ditch uvloop and rely on default asyncio event loop
ARGO-4691 Refine Jenkinsfile to execute test with Poetry and epel-9-ams

Added

ARGO-4689 Connectors Rocky 9 development container
ARGO-4792 Local flake8 linting settings
ARGO-4945 Extend GOCDB downtimes connector to fetch scoped entries

- Python
Published by themiszamani about 1 year ago

https://github.com/argoeu/argo-connectors - Version 2.2.4

ARGO-4428 Parse horizontalService flag now under main service bucket

- Python
Published by themiszamani over 2 years ago

https://github.com/argoeu/argo-connectors - Version 2.2.3

Added

ARGO-3665 Introduce random retry feature
ARGO-4169 Add agora topology connector
ARGO-4233 Implement gzip for jsonwrite

Changed

ARGO-4248 Remove handling of getsitecontacts and getservicegroup_roles GOCDB PI methods

Fixed

ARGO-4212 Refactor argo-connectors by removing hardcoded urls
ARGO-4236 Handle hostnames with spaces and non-utf characters
ARGO-4317 Original hostname is missing in tags bucket when ID append is enabled for GOCDB tenants

- Python
Published by themiszamani about 3 years ago

https://github.com/argoeu/argo-connectors - Version 2.2.2

remove python3-avro dependancy

- Python
Published by themiszamani over 3 years ago

https://github.com/argoeu/argo-connectors - Version 2.2.1

Added

ARGO-4011 Fetch Horizontal services from PROVIDERS portal

Fixed

ARGO-4057 Downtimes GOCDB connector does not take into account AuthN options
ARGO-4099 Do not try to parse EXTENSIONS for GOCDB sub services

- Python
Published by themiszamani over 3 years ago

https://github.com/argoeu/argo-connectors - Version 2.2.0

Features - ARGO-3695 [NEANIAS] Use ARGO for downtimes

- Python
Published by themiszamani almost 4 years ago

https://github.com/argoeu/argo-connectors - Version 2.1.0

Added

ARGO-2862 Introduce topo, weights, downtimes and metricprofile individual async tasks
ARGO-3583 Add support in Connectors for EOSC Providers Portal API
ARGO-3666 Introduce service type and descriptions fetch
ARGO-3700 EOSC topology service endpoints with only one hardcoded service for start
ARGO-3803 Use id as a service group name for EOSC PROVIDER topology
ARGO-3818 Use id as a project name for EOSC PROVIDER topology instead of abbreviation
ARGO-3849 Fetch monitoring extensions

Fixed

ARGO-3708 EOSCPROVIDER contacs is wrongly populated with one contact for every different endpoint
ARGO-3858 Slow performance with mesh of contacts data for EOSCPROVIDER topo
ARGO-3861 Some of endpoints are skipped if multiple endpoints are defined for the same resource on service-extensions
ARGO-3866 EOSC topology issue when defining two endpoints with the same hostname/service-type through monitoring extensions
ARGO-3869 Strip port from extracted hostname in group endpoints

Changed

ARGO-3842 Rename py modules and pkg to argo-connectors
ARGO-3846 Do not assume first fetch with paginated indexes succesfull
ARGO-3855 Join error lines for PROVIDER topology
ARGO-3856 findnextpagingcursorcount for GOCDB topo task implies succesfull parse

- Python
Published by themiszamani about 4 years ago

https://github.com/argoeu/argo-connectors - Version 2.0.0

[2.0.0] - 2022-02-10

ARGO-3375 Pass contacts for each topology entity
ARGO-3427 Fetch HOSTDN service attribute from GOCDB
ARGO-3428 Fetch SE_PATH from BDII
ARGO-3448 NEANIAS dulpicates in group topology
ARGO-3503 Support multiple VO SE_PATHs for host
ARGO-3521 Retry on empty responses
ARGO-3522 Introduce optional scope key for topology fetch and BIOMED feed parse
ARGO-3524 Improve exception handling
ARGO-3528 Verbose retry log messages
ARGO-3540 Tests for retry logic

Added

ARGO-2620 Update connectors configuration templates
ARGO-2622 Populate group_type field for WEB-API weights
ARGO-3064 Introduce async topology CSV
ARGO-3215 Pass EXTENSIONS bucket in new connectors
ARGO-3295 Add GOCDB URLs
ARGO-3301 Query BDII and extract SRM port
ARGO-3335 Retry on LDAP queries
ARGO-3340 Unit testing of parsing of GOCDB service endpoint
ARGO-3341 Pass date argument to WEB-API methods

Fixed

ARGO-2621 Detect missing path separator for tenant directory avros
ARGO-2660 Basic HTTP authentication not correctly set up
ARGO-2681 Weights use HTTP PUT to write new daily entries
ARGO-2771 Weight connector issues investigated
ARGO-3268 Downtimes DELETE with explicit date passed

Changed

ARGO-2591 Connectors CentOS7 and Py3 migrate
ARGO-2596 Push sync_data to WEB-API
ARGO-2619 Remove Centos 6 RPM building
ARGO-2656 Downtimes as global tenant resource
ARGO-2860 Separate connection, parsing and file handling
ARGO-2861 Switch to async IO operations

- Python
Published by themiszamani over 4 years ago

https://github.com/argoeu/argo-connectors - Version 1.7.3-1

Fixes - ARGO-2017 - Token per tenants config option - ARGO-2013 - Metric profiles WEB-API connector - ARGO-1549 - New helper tool that can replay avro data on AMS with customizable datestamp - ARGO-1575 - Switch poem-connector to use new token protected POEM API

- Python
Published by themiszamani over 6 years ago

https://github.com/argoeu/argo-connectors - Version 1.7.2

Features

Use requests library in connectors

- Python
Published by themiszamani over 7 years ago

https://github.com/argoeu/argo-connectors - Version 1.7.1-1

Features: * ARGO-1428 ServiceGroup topology filtering * ARGO-1370 Optimize connectors queries to POEM

Fixes * ARGO-1269 Refactor poem-connector * ARGO-1236 Datestamp of AMS msg does not match corresponding avro filename

- Python
Published by kkoumantaros over 7 years ago

https://github.com/argoeu/argo-connectors - Version 1.7.0

Features - Basic HTTP auth support (topology, downtimes) - selectively use GOCDB paginated API for topology
- update doc with plain HTTP auth options - added group groups sites feed tests - append query URL part on redirect - use lower level ams-library calls - test for basic HttpAuth config options - Location header check on first tuple element - handle HTTP redirects - pass also empty XML fields - tags values can have True/False strings

Fixes - fix no scope defined case - fixed ResponseNotReady bug - retry if no Location header set

- Python
Published by themiszamani about 8 years ago

https://github.com/argoeu/argo-connectors - Version 1.6.1-1

Features - Basic HTTP auth support (topology, downtimes) - selectively use GOCDB paginated API for topology
- update doc with plain HTTP auth options - added group groups sites feed tests - append query URL part on redirect - use lower level ams-library calls - test for basic HttpAuth config options - Location header check on first tuple element - handle HTTP redirects - pass also empty XML fields - tags values can have True/False strings

Fixes - fix no scope defined case - fixed ResponseNotReady bug - retry if no Location header set

- Python
Published by themiszamani about 8 years ago

https://github.com/argoeu/argo-connectors - Version 1.6.1-1

selectively use GOCDB paginated API for topology

- Python
Published by themiszamani over 8 years ago

https://github.com/argoeu/argo-connectors - Version 1.6.0-1

+* Thu Nov 30 2017 Daniel Vrcic dvrcic@srce.hr - 1.6.0-1%{?dist} +- ARGO-965 Support for packing connectors data in a single AMS message +- ARGO-921 Use ComputationPower instead of HEPSPEC2006 value for weights +- ARGO-906 No explicit exit on connection problem so state file will be written +- ARGO-886 Finer retry logic +- ARGO-872 Tenant and jobname in retries log msgs +- ARGO-853 Connectors retry to fetch data +- ARGO-843 Write/send data as it is data for passed date +- ARGO-842 Connectors dedicated file logger +- ARGO-549 Use of AMS for delivering topology, downtimes, POEM profile and weights +- added unit tests

- Python
Published by kkoumantaros over 8 years ago

https://github.com/argoeu/argo-connectors - Version 1.5.9

Features - every connector tries to create states dir structure - look back twice of number of saved state files

- Python
Published by themiszamani about 9 years ago

https://github.com/argoeu/argo-connectors - Version 1.5.8

Features - Remove topology-vo connector - Remove SRMv2 service type mapping

- Python
Published by themiszamani about 9 years ago

https://github.com/argoeu/argo-connectors - Version-1.5.6

Fixes - filter topology by particular site or NGI - remove inspection logic of weights factors for previous days

- Python
Published by themiszamani over 9 years ago

https://github.com/argoeu/argo-connectors - Version 1.5.4-1

Features - Filter endpoints whose groups are filtered in groups of groups - Prefilter output datestamp with underscores - Prefilter datestamp extracted from arg tuple - Introduce states that can be checked by Nagios probe

Fixes - Poem and output files as arguments to prefilter - Refactored filename datestamp creation

- Python
Published by themiszamani over 9 years ago

https://github.com/argoeu/argo-connectors - V1.5.1-2

Bugs - [ARGO-584] - Ensure to catch all exceptions of underlying library

- Python
Published by themiszamani over 9 years ago

https://github.com/argoeu/argo-connectors - v1.5.0-1

Breaking changes: - [ARGO-546] - switch from GSTAT to VAPOR service

New features/Enhancements: - connection timeouts, retries, config files as arguments - log failed VO and weights connections ARGOeu/ARGO#179 - added connection timeout for all connectors - config files can be passed as arguments to every component ARGOeu/ARGO#180 - added connection retry feature for all connectors - prefilter explicit input and output - reorganized prefilter global.conf - DATE placeholder in global.conf so interpolation can be used - prefilter poem_sync.out look back option - remove obsoleted logging - refactored connection retries - topology data without mixed int and string values - poem-connector optional write of prefilter data - remove deprecated BaseException message - poem-connector optional write of prefilter data - remove deprecations - poem connector optional write data needed for prefilter

Documentation updates: - User guide update

- Python
Published by themiszamani almost 10 years ago