cessda.metadata.harvester - 3.6.0

Changed

• Harvest records to a temporary file, throw an IOException if the HttpClient is interrupted (PR-48)
• Updated SND endpoint domain, metadata prefix and OAI-PMH set (PR-50)
• Updated OpenJDK to version 21 (#658)
• Updated SQAaaS software quality badge (#661)

Fixed

• Fixed only harvesting 100 records from SND (#655)

New Contributors

• @borsna made their first contribution in https://github.com/cessda/cessda.metadata.harvester/pull/50
• @Joshocan made their first contribution in https://github.com/cessda/cessda.metadata.harvester/pull/57

Full Changelog: https://github.com/cessda/cessda.metadata.harvester/compare/3.5.0...3.6.0

- Java
Published by matthew-morris-cessda about 2 years ago

cessda.metadata.harvester - 3.4.0

NOTICE: The location of the harvesting configuration when running on the CESSDA Cloud Platform has changed, and can be found at https://github.com/cessda/cessda.cdc.aggregator.deploy/blob/main/charts/harvester/config/config.yaml. Changing application-cdc.yaml in this repository will have no effect.

What's Changed

• Change the endpoint used for harvesting metadata from DANS by @john-shepherdson in https://github.com/cessda/cessda.metadata.harvester/pull/21
• Update SND endpoint due to restructuring of the SND catalogue by @john-shepherdson in https://github.com/cessda/cessda.metadata.harvester/pull/22
• Remove the ability to "unwrap" records, enable streaming records directly to disk by @matthew-morris-cessda in https://github.com/cessda/cessda.metadata.harvester/pull/24
• Fix MD formatting in CHANGELOG.md & change MD007 defaults by @toni-sissala in https://github.com/cessda/cessda.metadata.harvester/pull/26
• Document "Repo" in the README and JavaDocs by @matthew-morris-cessda in https://github.com/cessda/cessda.metadata.harvester/pull/27
• Remove properties from the readme that have no effect, improve the code comments in the HTTP client by @matthew-morris-cessda in https://github.com/cessda/cessda.metadata.harvester/pull/29

Full Changelog: https://github.com/cessda/cessda.metadata.harvester/compare/3.3.0...3.4.0

- Java
Published by matthew-morris-cessda almost 3 years ago

cessda.metadata.harvester - 3.3.0

What's Changed

• Update AUSSDA's endpoint setspec in application-cdc.yaml by @john-shepherdson in https://github.com/cessda/cessda.metadata.harvester/pull/11
• Remove Apache Xalan due to CVE-2022-34169, fix not parsing OAI-PMH metadata formats if the XML uses a namespace prefix by @matthew-morris-cessda in https://github.com/cessda/cessda.metadata.harvester/pull/9
• Add retry logic for failed HTTP requests by @matthew-morris-cessda in https://github.com/cessda/cessda.metadata.harvester/pull/4
• Improve the harvester's SQA rating by @toni-sissala in https://github.com/cessda/cessda.metadata.harvester/pull/13
• Add CSDA's endpoint to application-cdc.yaml by @john-shepherdson in https://github.com/cessda/cessda.metadata.harvester/pull/18

New Contributors

• @toni-sissala made their first contribution in https://github.com/cessda/cessda.metadata.harvester/pull/13

Full Changelog: https://github.com/cessda/cessda.metadata.harvester/compare/3.2.1...3.3.0

- Java
Published by matthew-morris-cessda about 3 years ago

cessda.metadata.harvester - 3.2.1

What's Changed

• Rename the main package from eu.cessda.eqb.harvester toeu.cessda.oaiharvester by @matthew-morris-cessda in https://github.com/cessda/cessda.metadata.harvester/pull/2
• Add new Sikt and ESS endpoints by @matthew-morris-cessda in https://github.com/cessda/cessda.metadata.harvester/pull/3
• 531 updated AUSSDA endpoint by @john-shepherdson in https://github.com/cessda/cessda.metadata.harvester/pull/5

Dependency Updates

• Bump spring-boot-starter-parent from 3.0.3 to 3.0.4 by @dependabot in https://github.com/cessda/cessda.metadata.harvester/pull/1
• Bump maven-release-plugin from 2.5.3 to 3.0.0 by @dependabot in https://github.com/cessda/cessda.metadata.harvester/pull/6

Full Changelog: https://github.com/cessda/cessda.metadata.harvester/compare/v3.2.1...3.2.1

- Java
Published by matthew-morris-cessda about 3 years ago