Updated 4 months ago
Cost-Effective Big Data Orchestration Using Dagster: A Multi-Platform Approach
Cost-Effective Big Data Orchestration Using Dagster: A Multi-Platform Approach - Published in JOSS (2026)
Updated 10 months ago
https://github.com/cdcgov/cdh-lava-react
CDC Data Hub Lifecycle, Analysis & Visualization Accelerator (LAVA) REACT Components based on machine readable requirements.
Updated 10 months ago
pysparklyr
Extension to {sparklyr} that allows you to interact with Spark & Databricks Connect
Updated 10 months ago
https://github.com/johnsnowlabs/johnsnowlabs
Gateway into the John Snow Labs Ecosystem
Updated 10 months ago
https://github.com/data-miner00/spark
A laboratory to carry out experiments with PySpark
Updated 10 months ago
https://github.com/dadananjesha/azuredataengine
AzureDataEngine is a robust, scalable batch processing data architecture built on the Azure platform. It efficiently extracts, transforms, and loads massive datasets for machine learning applications, leveraging Azure Blob Storage, PostgreSQL, Databricks, and Key Vault to ensure reliability and maintainability.