Projects

Scientific Software

Updated 6 months ago

cuallee — Peer-reviewed • Rank 18.9 • Science 98%

cuallee: A Python package for data quality checks across multiple DataFrame APIs - Published in JOSS (2024)

bigdata data-quality data-quality-checks dataquality pandas performance-metrics pydeequ pyspark python3 snowpark unit-testing

Scientific Software · Peer-reviewed

Updated 6 months ago

great_expectations • Rank 32.6 • Science 77%

Always know what to expect from your data.

cleandata data-engineering data-profilers data-profiling data-quality data-science data-unit-tests datacleaner datacleaning dataquality dataunittest eda exploratory-analysis exploratory-data-analysis exploratorydataanalysis mlops pipeline pipeline-debt pipeline-testing pipeline-tests

Updated 6 months ago

https://github.com/ibm/lale • Rank 17.7 • Science 36%

Library for Semi-Automated Data Science

artificial-intelligence automated-machine-learning automl data-science dataquality hyperparameter-optimization hyperparameter-search hyperparameter-tuning ibm-research ibm-research-ai interoperability machine-learning pipeline-testing pipeline-tests python scikit-learn

Updated 6 months ago

https://github.com/awslabs/deequ • Rank 16.5 • Science 36%

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

dataquality scala spark unit-testing

Updated 6 months ago

https://github.com/datafold/data-diff • Rank 24.5 • Science 13%

Compare tables within or across databases

data data-diffing data-engineering data-quality data-quality-monitoring data-science database databricks-sql dataengineering dataquality dbt mysql oracle-database postgres postgresql python rdbms snowflake sql trino