Cost-Effective Big Data Orchestration Using Dagster: A Multi-Platform Approach
Cost-Effective Big Data Orchestration Using Dagster: A Multi-Platform Approach - Published in JOSS (2026)
https://github.com/awslabs/gluonts
Probabilistic time series modeling in Python
ia-webscraping
An AWS workflow for collecting webpages from the Internet Archive
https://github.com/aws/aws-cdk
The AWS Cloud Development Kit is a framework for defining cloud infrastructure in code
geos-chem
GEOS-Chem "Science Codebase" repository. Contains GEOS-Chem science routines, run directory generation scripts, and interface code. This repository is used as a submodule within the GCClassic and GCHP wrappers, as well as in other modeling contexts (external ESMs).
https://github.com/awslabs/aws-sdk-rust
AWS SDK for the Rust Programming Language
hemco
The Harmonized Emissions Component (HEMCO), developed by the GEOS-Chem Support Team.
terrascan
Detect compliance and security violations across Infrastructure as Code to mitigate risk before provisioning cloud native infrastructure.
gcclassic
This repository contains the "superproject" wrapper for the "Classic" configuration of the GEOS-Chem model of atmospheric chemistry and composition.
prowler
Prowler is the Open Cloud Security platform for AWS, Azure, GCP, Kubernetes, M365 and more. It helps for continuous monitoring, security assessments & audits, incident response, compliance, hardening and forensics readiness. Includes CIS, NIST 800, NIST CSF, CISA, FedRAMP, PCI-DSS, GDPR, HIPAA, FFIEC, SOC2, ENS and more
toil
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
https://github.com/awslabs/agent-squad
Flexible and powerful framework for managing multiple AI agents and handling complex conversations
integrated_methane_inversion
Integrated Methane Inversion workflow repository.
https://github.com/awslabs/mcp
AWS MCP Servers — helping you get the most out of AWS, wherever you use MCP.
https://github.com/awslabs/mountpoint-s3
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
https://github.com/awslabs/aws-well-architected-labs
Hands on labs and code to help you learn, measure, and build using architectural best practices.
https://github.com/beuth-erdelt/benchmark-experiment-host-manager
This python tool helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.
https://github.com/agnostiqhq/covalent-braket-plugin
Executor plugin interfacing Covalent with Amazon Braket Hybrid Jobs
https://github.com/awslabs/coldsnap
A command line interface for Amazon EBS snapshots
https://github.com/awslabs/generative-ai-cdk-constructs
AWS Generative AI CDK Constructs are sample implementations of AWS CDK for common generative AI patterns.
https://github.com/awslabs/aws-config-rdk
The AWS Config Rules Development Kit helps developers set up, author and test custom Config rules. It contains scripts to enable AWS Config, create a Config rule and test it with sample ConfigurationItems.
https://github.com/awslabs/amazon-transcribe-streaming-sdk
The Amazon Transcribe Streaming SDK is an async Python SDK for converting audio into text via Amazon Transcribe.
terraform-aws-billing-export
Terraform Module witch creates billing export, including FOCUS, on AWS.
https://github.com/awslabs/iot-app-kit
A development library for creating web applications to visualize industrial data
https://github.com/awslabs/sagemaker-debugger
Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors
https://github.com/awslabs/wdio-aws-device-farm-service
AWS Device Farm service for WebdriverIO
https://github.com/awslabs/aws-ddk
An open source development framework to help you build data workflows and modern data architecture on AWS.
workbench
Workbench: An easy to use Python API for creating and deploying AWS SageMaker Models
https://github.com/awslabs/nx-plugin-for-aws
The @aws/nx-plugin is a collection of code generators that automate the creation and configuration of cloud-native applications using AWS, TypeScript, Python and React within the Nx development ecosystem.
https://github.com/agnostiqhq/covalent-aws-plugins
Executor plugins interfacing Covalent with various AWS compute platforms
https://github.com/awslabs/aws-iot-core-credential-provider-session-helper
This package provides an easy way to create a refreshable Boto3 Session using the AWS IoT Core credential provider.
https://github.com/awslabs/aws-mobile-appsync-sdk-js
JavaScript library files for Offline, Sync, Sigv4. includes support for React Native
https://github.com/awslabs/aws-cloudsaga
AWS CloudSaga - Simulate security events in AWS
https://github.com/awslabs/aws-greengrass-labs-iot-pubsub-sdk-for-python
AWS IoT Greengrass PubSub SDK for Python
https://github.com/awslabs/aws-mobile-appsync-sdk-ios
iOS SDK for AWS AppSync.
https://github.com/awslabs/aws-mobile-appsync-sdk-android
Android SDK for AWS AppSync.
https://github.com/awslabs/fhir-works-on-aws-routing
The routing implementation of the FHIR Works on AWS framework. Finding the correct component to handle the HTTP FHIR request
https://github.com/awslabs/renate
Library for automatic retraining and continual learning
sentinelhub-py
Download and process satellite imagery in Python using Sentinel Hub services.
geospatial-data-catalogs
A list of open geospatial datasets available on AWS, Earth Engine, Planetary Computer, NASA CMR, and STAC Index
https://github.com/awslabs/aws-sdk-ios-samples
This repository has samples that demonstrate various aspects of the AWS SDK for iOS, you can get the SDK source on Github https://github.com/aws-amplify/aws-sdk-ios/
https://github.com/awslabs/aws-shell
An integrated shell for working with the AWS CLI.
https://github.com/bayer-group/bayerclaw
BayerCLAW workflow orchestration system for AWS
spruce
Enrichment pipeline for CUR reports which adds energy and carbon data allowing to report and reduce the impact of the your cloud usage.
https://github.com/awslabs/aws-orbit-workbench
A Data Platform built for AWS, powered by Kubernetes.
https://github.com/beomi/tf-keras-on-lambda
Example Repo for Tensorflow + Keras on AWS Lambda
https://github.com/azavea/django-ecsmanage
Run any Django management command on an AWS Elastic Container Service (ECS) cluster.
https://github.com/awslabs/project-lakechain
:zap: Cloud-native, AI-powered, document processing pipelines on AWS.
https://github.com/awslabs/fhir-works-on-aws-interface
The interface for the FHIR Works on AWS framework. This package is the glue that allows communication to flow between components
https://github.com/awslabs/clickstream-unity
Unity SDK for Clickstream Analytics on AWS
https://github.com/3mcloud/falcano
A pythonic interface to Amazon's DynamoDB for single-table design
https://github.com/awslabs/green-boost
Build Full Stack Cloud Native Web Apps on AWS Fast
https://github.com/awslabs/fhir-works-on-aws-search-es
An Elasticsearch implementation of the FHIR Works on AWS framework, enabling users to search for FHIR resources
https://github.com/awslabs/fhir-works-on-aws-persistence-ddb
A DynamoDB implementation of the FHIR Works on AWS framework, enabling users to complete CRUD operations on FHIR resources
https://github.com/awslabs/amplify-graphql-seed-plugin
This is an Amplify Plugin which helps your to seed the databases of your Amplify projects with data using an AppSync GraphQL API. It can be used to seed local mock databases, as well as remote databases, e.g. for testing purposes. This plugin allows you to customize and auto-generate mock data, including data with relationships between models.
https://github.com/awslabs/amazon-app-runner-deploy
Registers an AWS AppRunner Service and deploys the application using the source code of a given GitHub repository. Supports both source code and Docker image based service
https://github.com/ibrahimcesar/middy-idempotent
🛵 📬 Idempotence Middy middleware for your AWS Lambdas
https://github.com/awslabs/fhir-works-on-aws-authz-rbac
A role based access control implementation of the FHIR Works on AWS framework, utilizing Cognito and User Groups to perform authorization
https://github.com/awslabs/aws-sdk-android-samples
This repository has samples that demonstrate various aspects of the AWS SDK for Android, you can get the SDK source on Github https://github.com/aws-amplify/aws-sdk-android/
https://github.com/awslabs/fhir-works-on-aws-authz-smart
A SMART on FHIR v1.0.0 implementation of the FHIR Works on AWS framework, utilizing OAuth2/OIDC authorization server to authorize requests
https://github.com/azavea/terraform-aws-ecs-cluster
A Terraform module to create an Amazon Web Services (AWS) EC2 Container Service (ECS) cluster.
https://github.com/awslabs/fhir-works-on-aws-persistence-facade
A façade implementation of the FHIR Works on AWS framework, enabling users to complete CRUD operations on FHIR resources by posting requests to connected microservices
https://github.com/awslabs/iam-roles-anywhere-session
This package provides an easy way to create a refreshable boto3 Session with AWS Roles Anywhere.
https://github.com/deepset-ai/haystack-sagemaker
🚀 This repo is a showcase of how you can use models deployed on AWS SageMaker in your Haystack Retrieval Augmented Generative AI pipelines
https://github.com/eomm/sqs-json-body-parser
Middyjs middleware to parse your AWS SQS events
https://github.com/aryashah2k/aws-gluoncv-coursera
A Repository Maintaining My Solutions And Additional Resources For The Course- AWS Computer Vision- Getting Started With GluonCV Offered By Amazon Web Services On Coursera
aws-ecr-public-for-oss-mirroring
Mirroring OSS images into the Public ECR Registry for the ECR pullthrough cache
aws-orgs-deny-scps-for-launchwizard
Prevent the EC2 Launch Wizard from being used to provision insecure resources
aws-orgs-minimal-aws-accounts
Isolating AWS resources into single purpose AWS Accounts
aws-server-permission-to-iam
Restricting instance SSH sessions through IAM & SSM Documents
https://github.com/ccao-data/data-architecture
Codebase for CCAO data infrastructure construction and management
distributed-cellprofiler
Run encapsulated docker containers with CellProfiler in the Amazon Web Services infrastructure.
aws-ssm-with-least-privilege-users-on-ec2s
Using pre-defined users on EC2s with AWS SSM for least privilege SSH
