https://github.com/elementary-data/elementary

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

○
CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
✓
Committers with academic emails
2 of 89 committers (2.2%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (12.4%) to scientific vocabulary

Keywords

analytics-engineer bigquery data-analysis data-governance data-lineage data-observability data-pipeline data-pipelines data-reliability data-warehouse dataops dbt dbt-artifacts dbt-packages lineage redshift snowflake

Keywords from Contributors

data-engineering mlops orchestration workflow-orchestration workflow-engine scheduler etl elt data-orchestrator airflow

Last synced: 5 months ago · JSON representation

Repository

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

Basic Info

Host: GitHub
Owner: elementary-data
License: apache-2.0
Language: HTML
Default Branch: master
Homepage: https://www.elementary-data.com/
Size: 208 MB

Statistics

Stars: 2,146
Watchers: 12
Forks: 195
Open Issues: 260
Releases: 103

Topics

Created over 4 years ago · Last pushed 6 months ago

Metadata Files

Readme Contributing License

README.md

Logo

dbt-native data observability for analytics & data engineers

⭐️ Star the repo

⭐ [Demo »](https://bit.ly/3IAp9wf) | [Docs »](https://docs.elementary-data.com/) | [Slack »](https://www.elementary-data.com/community)

What is Elementary?

Elementary is a dbt-native data observability solution for data and analytics engineers. Set up in minutes, gain immediate visibility, detect data issues, send actionable alerts, and understand impact and root cause. Elementary has two offerings: an open-source package and managed platform.

Open-source Package vs. Cloud Platform

Elementary Cloud Platform

Ideal for teams monitoring mission-critical data pipelines, requiring guaranteed uptime and reliability, short-time-to-value, advanced features, collaboration, and professional support. The solution is secure by design, and requires no access to your data from cloud.

Get started with Elementary Cloud

Open-source Package

Elementary Community is an open-source CLI tool you can deploy and orchestrate to send Slack alerts and self-host the Elementary report. It is best for data and analytics engineers that require basic observability capabilities.

Get started with the Open-source Package

Features

Anomaly detection tests - Collect data quality metrics and detect anomalies, as native dbt tests.

Automated monitors - Out-of-the-box cloud monitors to detect freshness, volume and schema issues.

End-to-End Data Lineage - Enriched with the latest test results, for impact and root cause analysis of data issues. Elementary Cloud offers Column Level Lineage and BI integrations.

Data quality dashboard - Single interface for all your data monitoring and test results.

Models performance - Monitor models and jobs run results and performance over time.

Configuration-as-code - Elementary configuration is managed in your dbt code.

Alerts - Actionable alerts including custom channels and tagging of owners.

Data catalog - Explore your datasets information - descriptions, columns, datasets health, etc.

dbt artifacts uploader - Save metadata and run results as part of your dbt runs.

AI-Powered Data Tests & Unstructured Data Validations - Validate and monitor data using AI powered tests to validate both structured and unstructured data

Support

For additional information and help, you can use one of these channels:

Slack community (Release announcements, community support, discussions, etc.)
GitHub issues (Bug reports, feature requests)
Check out the contributions guide and open issues.

Elementary contributors: ✨

Owner

Name: Elementary
Login: elementary-data
Kind: organization

Website: https://www.elementary-data.com/
Repositories: 20
Profile: https://github.com/elementary-data

Dev-first data observability for data and analytics engineers

Committers

Last synced: 9 months ago

All Time

Total Commits: 4,036
Total Committers: 89
Avg Commits per committer: 45.348
Development Distribution Score (DDS): 0.752

Past Year

Commits: 338
Committers: 29
Avg Commits per committer: 11.655
Development Distribution Score (DDS): 0.586

Top Committers

Name	Email	Commits
Elon Gliksberg	e**s@g**m	1,002
Maayan-s	m**m@g**m	821
IDoneShaveIt	i**1@g**m	660
oravi	o**0@g**m	463
Itamar Hartstein	h**r@g**m	151
MikaKerman	m**n@g**m	140
Noy Arie	n**2@g**m	101
Ella Katz	e**a@e**m	83
RoiTabach	r**h@g**m	76
Ofek Weiss	o**s@g**m	69
Hahnbee Lee	h**5@c**u	44
GitHub Actions	n**y@g**m	35
Frank Tubbing	f**g@b**l	33
Daniel Pollak	d**l@e**m	32
Hadar	1****v	27
Ofek Weiss	o**k@e**m	22
Han Wang	h**2@c**u	19
erikzaadi	e**k@e**m	17
Marcell Kovács	me@m****m	16
Gal Polak	g**k@y**m	15
Michael Myaskovsky	m**l@e**m	15
nimrodne	n**g@g**m	12
noakurman	k**a@g**m	12
Yu ISHIKAWA	y**a@g**m	12
GuyEshdat	g**t@g**m	10
Manul Patel	m**9@g**m	8
Shahaf Shaked	s**s@w**m	8
aaron-westlake	a**e@s**m	7
Arun KC	a**1@g**m	7
ronisaban2024	1****4	5
and 59 more...

Committer Domains (Top 20 + Academic)

elementary-data.com: 6 cornell.edu: 2 beequip.nl: 2 tangocard.com: 2 github.com: 1 marcellkovacs.com: 1 welldone-software.com: 1 saks.com: 1 octoenergy.com: 1 renttherunway.com: 1 multilayer.io: 1 ecosia.org: 1 ouraring.com: 1 hotmail.co.uk: 1 loft.com.br: 1 outlook.fr: 1 ailylabs.com: 1 crisp.nl: 1 petsathome.co.uk: 1 pagaya.com: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time

Total issues: 404
Total pull requests: 1,033
Average time to close issues: 3 months
Average time to close pull requests: 7 days
Total issue authors: 261
Total pull request authors: 76
Average comments per issue: 1.52
Average comments per pull request: 1.3
Merged pull requests: 807
Bot issues: 1
Bot pull requests: 75

Past Year

Issues: 79
Pull requests: 364
Average time to close issues: 7 days
Average time to close pull requests: 5 days
Issue authors: 72
Pull request authors: 37
Average comments per issue: 0.37
Average comments per pull request: 1.16
Merged pull requests: 264
Bot issues: 1
Bot pull requests: 36

View more stats

Top Authors

Issue Authors

Maayan-s (29)
oravi (24)
elongl (14)
jelstongreen (6)
ofek1weiss (5)
christopherekfeldt (5)
garfieldthesam (5)
FrankTub (4)
kokorin (4)
IDoneShaveIt (4)
RoiTabach (3)
yu-iskw (3)
eraliod (3)
haritamar (3)
darryk10 (3)

Pull Request Authors

elongl (131)
ofek1weiss (90)
MikaKerman (89)
haritamar (72)
IDoneShaveIt (72)
NoyaArie (64)
github-actions[bot] (61)
oravi (57)
Maayan-s (55)
ellakz (52)
dapollak (28)
GuyEshdat (19)
noaKurman (18)
okabak123 (18)
ronisaban2024 (17)

Top Labels

Issue Labels

Triage 👀 (242) Bug (175) Feature Request 💡 (168) linear (63) Open to contribution 🧡 (45) dbt package (44) Observability UI (20) integration (18) CLI (16) Alerts (13) Contribution (12) Enhancement (11) Anomaly Detection (11) Product review (10) Good First Issue 🥇 (9) Documentation (8) Community (7) Urgent (7) Lineage (6) BigQuery (5) Awaiting Response (5) FE (5) dbt artifacts (4) Feature (3) UX issue (2) dataops (2) Improvement (2) slack alerts (2) tech-debt (1) Infra (1)

Pull Request Labels

Awaiting Response (2)

Packages

Total packages: 3
Total downloads:
- pypi 1,143,904 last-month
Total docker downloads: 990

Total dependent packages: 0
(may contain duplicates)
Total dependent repositories: 2
(may contain duplicates)
Total versions: 215
Total maintainers: 1

proxy.golang.org: github.com/elementary-data/elementary

Documentation: https://pkg.go.dev/github.com/elementary-data/elementary#section-documentation
License: apache-2.0
Latest release: v0.19.5
published 6 months ago

Versions: 103
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 5.4%

Average: 5.6%

Dependent repos count: 5.8%

Last synced: 6 months ago

pypi.org: elementary-data

Data monitoring and lineage

Homepage: https://www.elementary-data.com
Documentation: https://docs.elementary-data.com
License: Apache-2.0
Latest release: 0.19.5
published 6 months ago

Versions: 86
Dependent Packages: 0
Dependent Repositories: 1
Downloads: 1,143,847 Last month
Docker Downloads: 990

Rankings

Downloads: 0.7%

Stargazers count: 1.8%

Docker downloads count: 1.9%

Forks count: 4.3%

Average: 6.3%

Dependent packages count: 7.3%

Dependent repos count: 22.1%

Maintainers (1)

oravidov

Last synced: 6 months ago

pypi.org: elementary-lineage

elementary-lineage is deprecated and moved to elementary-data

Homepage: https://github.com/elementary-data/elementary
Documentation: https://elementary-lineage.readthedocs.io/
License: Apache Software License
Latest release: 0.1.4
published about 4 years ago

Versions: 26
Dependent Packages: 0
Dependent Repositories: 1
Downloads: 57 Last month

Rankings

Stargazers count: 1.8%

Forks count: 4.3%

Dependent packages count: 7.3%

Average: 11.0%

Downloads: 19.5%

Dependent repos count: 22.1%

Maintainers (1)

oravidov

Last synced: 6 months ago

Dependencies

dev-requirements.txt pypi

pytest * development
twine * development

.github/workflows/bump-version.yml actions

actions/checkout v3 composite
actions/github-script v6 composite
repo-sync/pull-request v2 composite

.github/workflows/notify_slack.yml actions

tokorom/action-slack-incoming-webhook main composite

.github/workflows/release.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite
docker/build-push-action v3 composite
docker/login-action v2 composite
docker/metadata-action v4 composite
pypa/gh-action-pypi-publish release/v1 composite
repo-sync/pull-request v2 composite

.github/workflows/remind-docs-and-tests.yml actions

wow-actions/auto-comment v1 composite

.github/workflows/run-precommit.yml actions

actions/checkout v3 composite
actions/setup-python v4.3.0 composite

.github/workflows/stale.yml actions

actions/stale v5 composite

.github/workflows/test-all-warehouses.yml actions

.github/workflows/test-github-action.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite
elementary-data/run-elementary-action v1.8 composite

.github/workflows/test-main-warehouse.yml actions

.github/workflows/test-release.yml actions

actions/github-script v6 composite

.github/workflows/test-warehouse.yml actions

actions/checkout v3 composite
actions/setup-python v4 composite
actions/upload-artifact v3 composite

.github/workflows/triage-labels.yml actions

andymckay/labeler master composite

Dockerfile docker

python 3.10.7 build

docs/Dockerfile docker

node 19 build

pyproject.toml pypi

alive-progress <=2.3.1
azure-storage-blob >=12.11.0
beautifulsoup4 <5.0.0
boto3 <2.0.0
click >=7.0,<8.1.4
dbt-bigquery >=0.20,<2.0.0
dbt-core >=0.20,<2.0.0
dbt-databricks >=0.20,<2.0.0
dbt-postgres >=0.20,<2.0.0
dbt-redshift >=0.20,<2.0.0
dbt-snowflake >=0.20,<2.0.0
dbt-spark >=0.20,<2.0.0
google-cloud-storage <3.0.0
networkx >=2.3,<3
packaging >=20.9,<=23.1
posthog <3.0.0
pydantic <2.0
pyfiglet <1.0.0
pytest-parametrization >=2022.2.1
python >=3.6.2
ratelimit *
requests >=2.28.1,<3.0.0
ruamel.yaml <1.0.0
slack-sdk >=3.20.1,<4.0.0