Recent Releases of https://github.com/awslabs/osml-data-intake
https://github.com/awslabs/osml-data-intake - v1.2.0
OSML Data Intake v1.2.0
In this release, we focused on improving stability, flexibility, and maintainability across the project. The ingest process is now more resilient, working even when no OVR file is provided, and the optional tile server configuration has been made more flexible by parameterizing its URL. We also made small but important updates to logging and the Dockerfile to streamline the developer experience.
On the CI/CD front, we added a manual workflow_dispatch trigger and updated Docker tagging practices to make builds easier to manage. Finally, we upgraded core dependencies to ensure continued security, performance, and compatibility with newer environments.
Breaking Changes:
- No breaking changes in this release.
Limitations:
- No known limitations in this release.
New Dependency:
- No new dependencies introduced in this release.
Pull Requests Merged
- fix: allow ingest without ovr file and minor logging updates by @jtblack-aws in https://github.com/awslabs/osml-data-intake/pull/21
- fix: parameterize the URL to the optional tile server by @jtblack-aws in https://github.com/awslabs/osml-data-intake/pull/22
- ci: add workflow_dispatch and update docker tags by @RanbirAulakh in https://github.com/awslabs/osml-data-intake/pull/23
- fix: updating Dockerfile by @drduhe in https://github.com/awslabs/osml-data-intake/pull/24
- feat: upgrade dependancies by @drduhe in https://github.com/awslabs/osml-data-intake/pull/25
- build: version update to v1.2.0 by @drduhe in https://github.com/awslabs/osml-data-intake/pull/26
Full Changelog: https://github.com/awslabs/osml-data-intake/compare/v1.1.2...v1.2.0
- Python
Published by drduhe 10 months ago
https://github.com/awslabs/osml-data-intake - v1.1.2
OSML Data Intake v1.1.2
This release brings important updates, including enhancements to the streaming and bulk ingest functionalities for improved compatibility with the UI. Additionally, the Lambda function has been updated to correctly return 500 errors, ensuring better error handling. Docker container size has also been optimized by reducing the number of layers, contributing to more efficient deployments.
Breaking Changes:
- No breaking changes in this release.
Limitations:
- No known limitations in this release.
New Dependency:
- No new dependencies introduced in this release.
Pull Requests Merged
- chore: Cleanup .gitignore by @drduhe
- fix: Updating stream and bulk ingest to work with UI by @jtblack-aws
- fix: Making Lambda correctly return 500 errors by @drduhe
- chore: Reduce Docker container size by optimizing layers by @RanbirAulakh
- build: Version update to v1.1.2 by @RanbirAulakh
New Contributors
- @jtblack-aws made their first contribution in Updating stream and bulk ingest to work with UI.
Full Changelog: https://github.com/aws-solutions-library-samples/osml-data-intake/compare/v1.1.1...v1.1.2
- Python
Published by RanbirAulakh almost 2 years ago
https://github.com/awslabs/osml-data-intake - v1.1.1
OSML Data Intake v1.1.1
Updating various CI components to build and publish Dockerhub images correctly. Fixing build dependencies for DataIntake and DataIngest containers to allow them to build correctly.
Breaking Changes:
N/A
Limitations:
N/A
New Dependency:
N/A
Pull Requests Merged
- chore: update meta tags in release.yml by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/11
- chore: updating docker image names to match convention by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/12
- chore: fixing typo in docker-publish.yml by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/13
- chore: fixing bugs to resolve intake and ingest builds by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/14
- build: version bump to v1.1.1 by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/15
Full Changelog: https://github.com/aws-solutions-library-samples/osml-data-intake/compare/v1.1.0...v1.1.1
- Python
Published by drduhe almost 2 years ago
https://github.com/awslabs/osml-data-intake - v1.1.0
OSML Data Intake 1.1.0
Implementing new component level features: * STAC ingest lambda which is required to support ingesting SpatioTemporal Asset Catalog (STAC) items from an SNS topic as part of the OSML guidance package. * We have integrated a new feature that allows users to submit an entire S3 bucket as a bulk job. This feature processes multiple images in parallel, significantly reducing wait times. As the images are processed, they are cataloged in bulk, streamlining the workflow and enhancing efficiency. * Generation of thumbnail imagery as part of the data intake component which creates 512x512 thumbnail images in addition to the aux and ovr files previously generated.
## Breaking Changes: N/A
Limitations:
N/A
New Dependency:
N/A
Pull Requests Merged
- feat: including collection_id in SNS message by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/6
- feat: genearte thumbnails for incoming imagery by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/7
- feat: implementing stac components by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/9
- feat: implementation of bulk ingest by @RanbirAulakh in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/5
- ci: version bump to v1.1.0 by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/10
Full Changelog: https://github.com/aws-solutions-library-samples/osml-data-intake/compare/v1.0.0...v1.1.0
- Python
Published by drduhe almost 2 years ago
https://github.com/awslabs/osml-data-intake - v1.0.0
What's Changed
- release: initial release of repository contents by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/1
- chore: update readme by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/2
- chore: update README.md by @RanbirAulakh in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/4
- feat: adding dataclass for request and cleaning up implementations by @drduhe in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/3
New Contributors
- @drduhe made their first contribution in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/1
- @RanbirAulakh made their first contribution in https://github.com/aws-solutions-library-samples/osml-data-intake/pull/4
Full Changelog: https://github.com/aws-solutions-library-samples/osml-data-intake/commits/v1.0.0
- Python
Published by RanbirAulakh about 2 years ago