rath

Next generation of automated data exploratory analysis and visualization platform.

Science Score: 54.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
○
DOI references
○
Academic publication links
✓
Committers with academic emails
1 of 21 committers (4.8%) from academic institutions
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (10.9%) to scientific vocabulary

Keywords

augmented-analytics automated-data-analysis automated-visualization autovis causal-discovery causal-inference causality data-analysis data-exploration data-visualization datamining eda k6s kanaries machine-learning tableau tableau-alternative visualization

Keywords from Contributors

cryptocurrencies mesh interpretability distribution transformers sequences generic projection interactive optim

Last synced: 4 months ago · JSON representation ·

Repository

Next generation of automated data exploratory analysis and visualization platform.

Basic Info

Host: GitHub
Owner: Kanaries
License: agpl-3.0
Language: TypeScript
Default Branch: master
Homepage: https://kanaries.net
Size: 82.3 MB

Statistics

Stars: 4,448
Watchers: 45
Forks: 360
Open Issues: 68
Releases: 5

Topics

Created over 6 years ago · Last pushed 6 months ago

Metadata Files

Readme Changelog Contributing License Citation

README.md

English | 日本語 | 简体中文

Introduction

RATH is not just an open-source alternative to Data Analysis and Visualization tools such as Tableau, but it automates your Exploratory Data Analysis workflow with an Augmented Analytic engine by discovering patterns, insights, causals and presents those insights with powerful auto-generated multi-dimensional data visualization.

RATH generates/recommends visualizations based on minimize visual perception error of information in visualizations.

https://user-images.githubusercontent.com/22167673/234053551-24e0f1c9-1efb-4250-a2f8-dbf148f5f4d0.mp4

[!TIP] If you want more AI features, we also build runcell, an AI Code Agent in Jupyter that understands your code/data/cells and generate code, execute cells and take actions for you. It can be used in jupyter lab with pip install runcell

https://github.com/user-attachments/assets/9ec64252-864d-4bd1-8755-83f9b0396d38

Get started

Get started with RATH now! - 🚀 Sandbox demo for parts of features - 📖 Read RATH Docs - Video introducing RATH's data painter

Features

🤖 AutoPilot for Data Exploration: Get Insights with One Click! Augmented analytic engine for discovering patterns, insights, and causals. A fully-automated way to explore and visualize dataset with one click.
🛠 Copilot for Data Exploration: RATH will work as your copilot in data science, learn your intends and generate relevant recommendations.
Natural Language interface: Ask questions in natural language to get answers/visualizations from your data.
AutoVis: RATH will generate the best visualization for the data you selected. It makes you focus on data and variables, not how to make a visualization.
👓 Data Wrangler: Automated data wrangler for generating summary of the data and data transformation.
🎨 Data Painter: An interactive, instinctive yet powerful tool for exploratory data analysis by directly coloring your data, with further analytical features. Watch this video demonstrating about how to discover data insights with Data Painter.
:bar_chart: Dashboard: Build a beautiful interactive data dashboard (including a automated dashboard designer which can provide suggestions to your dashboard).
Causal Analysis: Identify and examine the causal relationship between variables, which can help explore the data, create better prediction models and make business decission.

Walkthroughs

Import data from online databases or CSV/JSON files.

View statistics from your data source

Data Preparation

RATH support data preparation with black magic like predictive transformation operations. It will automatically generate suggestions of transformations and cleaning, etc.

One-click automated data analysis with visualizations

Augmented analytic engine for discovering patterns, insights, and causals. A fully-automated way to explore and visualize dataset with one click.

Use RATH as your Copilot in Data Exploration

RATH will work as your copilot in data science, learn your intends and generate relevant recommendations.

https://user-images.githubusercontent.com/22167673/234018034-c7441549-e83b-4f5e-94c7-f772527a7094.mp4

Ask about your data

Ask questions about your data, RATH integrates with GPT to generate answers and visualizations.

Manually explore your data with drag and drop:

Manual Exploration is an independent embedding module. You can use it independently in your apps. For more details, refer to the README.md in in packages/graphic-walker/README.md.

Install Graphic Walker ```bash yarn add @kanaries/graphic-walker

or

npm i --save @kanaries/graphic-walker ```

:sparkles: Interactive data analysis workflow by data painting

Data Painter Video 🔥 on Youtube

🌅 Causal Analysis (Alpha stage)

Causal analysis could be defined as the way to identify and examine the causal relationship between variables, which can help explore the data, create better prediction models and make business decision.

RATH's causal analysis feature include: - Causal Discovery - Editable graphical causal models - Causal interpretability - Interactive tools for deeper exploration - What-if analysis

Causal Analysis

For more about Causal Analysis features, refer to RATH Docs.

Supported Databases

RATH supports a wide range of data sources. Here are some of the major database solutions that you can connect to RATH:

Amazon Athena Amazon Redshift Apache Spark SQL Apache Doris Clickhouse Apache Hive MySQL Postgre SQL Apache Impala Apache Kylin Oracle AirTable

If you want to add support for more database types or data engines, feel free to Contact us

Developer Documentation

RATH software is in open alpha stage. We are working on improving its code and documentation.

build script for client parts ```bash yarn install

yarn workspace rath-client build ```

If you are using RATH for your project(s), please let us know what are you using it for by emailing us at support@kanaries.org. Feedbacks are also welcomed. If you find a bug or have a feature request, please create an issue.

We encourage you to check out our RATH Docs for references and guidance.

Project Status

Alt

Community

Kanaries community is a place to have open discussions on features, voice your ideas, or get help with general questions. Get onboard with us through the following channels:

Our developer community is the backbone of the ongoing RATH project. We sincerely welcome you to join our community, participate in the conversation and stay connected with us for the latest updates. - Join our Slack - Join our Discord

Feel free to contribute to the RATH project, submit any issues on our GitHub page, or split your grand new ideas in our chats.

Please consider sharing your experience or thoughts about Kanaries RATH with the border Open Source community. It really does help!

Contributions

Please check out the Contributing to RATH guide for guidelines about how to proceed.

Thanks to all contributors :heart:

LICENSE (AGPL)

Rath is an automated data analysis and visualization tool (auto-EDA). It is a free and open-source software licensed under the AGPL.

Branded icons are licensed under their copyright license.

Have fun with data! ❤️

⬆ Back to Top

Owner

Name: Kanaries
Login: Kanaries
Kind: organization
Email: support@kanaries.org

Website: https://kanaries.net
Twitter: kanaries_data
Repositories: 10
Profile: https://github.com/Kanaries

Build data tools from the future

Citation (citations.md)

## Reference

Rath is insipired by several excellent works below:
+ [1] Cleveland, W., & McGill, R. (1984). Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods. Journal of the American Statistical Association, 79(387), 531-554. doi:10.2307/2288400
+ [2] Mackinlay, Jock D. Automatic design of graphical presentations. Stanford Univ., CA (USA), 1987.
+ [3] Wongsuphasawat, Kanit, et al. "Voyager 2: Augmenting visual analysis with partial view specifications." Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2017.
+ [4] B. Tang et al, "Extracting top-K insights from multi-dimensional data," in 2017, . DOI: 10.1145/3035918.3035922.
+ [5] Vega-Lite: A Grammar of Interactive Graphics. Arvind Satyanarayan, Dominik Moritz, Kanit Wongsuphasawat, Jeffrey Heer. IEEE Trans. Visualization & Comp. Graphics (Proc. InfoVis), 2017
+ [6] Kim, Younghoon, et al. "Graphscape: A model for automated reasoning about visualization similarity and sequencing." Proceedings of the 2017 CHI conference on human factors in computing systems. 2017.
+ [7] Amit Sharma, Emre Kiciman. DoWhy: An End-to-End Library for Causal Inference. 2020. https://arxiv.org/abs/2011.04216

GitHub Events

Total

Issues event: 6
Watch event: 257
Issue comment event: 7
Push event: 7
Pull request event: 8
Fork event: 48
Create event: 3

Last Year

Issues event: 6
Watch event: 257
Issue comment event: 7
Push event: 7
Pull request event: 8
Fork event: 48
Create event: 3

Committers

Last synced: 8 months ago

All Time

Total Commits: 1,332
Total Committers: 21
Avg Commits per committer: 63.429
Development Distribution Score (DDS): 0.496

Past Year

Commits: 3
Committers: 2
Avg Commits per committer: 1.5
Development Distribution Score (DDS): 0.333

Top Committers

Name	Email	Commits
ObservedObserver	2**1@q**m	671
kyusho	a**9@g**m	393
jojocys	y**y@g**m	95
Asm.Def	w**n@z**n	62
k6sdevbob	d**b@k**t	23
qimeng	3**8@q**m	22
dependabot[bot]	4****]	18
ysj0226	y**j@k**g	17
islxyqwe	i**3@g**m	7
p1ng-request	1****t	5
dev02	k**2@o**m	4
qimeng	7****3	3
longxiaofei	l**2@g**m	2
Anatolii Lapytskyi	a**a@a**m	2
hjy	2**5@q**m	2
0xflotus	0**s@g**m	1
Ben Lesh	b**n@b**m	1
Miao Cai	p**y@g**m	1
Yuhang	2**7@q**m	1
exift	1****t	1
wgzhao	w**o@g**m	1

Committer Domains (Top 20 + Academic)

qq.com: 4 benlesh.com: 1 allunite.com: 1 kanaries.org: 1 kanaries.net: 1 zju.edu.cn: 1

Issues and Pull Requests

Last synced: 8 months ago

All Time

Total issues: 37
Total pull requests: 82
Average time to close issues: about 1 year
Average time to close pull requests: 2 months
Total issue authors: 14
Total pull request authors: 5
Average comments per issue: 0.78
Average comments per pull request: 0.51
Merged pull requests: 54
Bot issues: 11
Bot pull requests: 35

Past Year

Issues: 7
Pull requests: 4
Average time to close issues: N/A
Average time to close pull requests: N/A
Issue authors: 7
Pull request authors: 2
Average comments per issue: 0.14
Average comments per pull request: 1.0
Merged pull requests: 0
Bot issues: 0
Bot pull requests: 0

View more stats

Top Authors

Issue Authors

ObservedObserver (12)
todo[bot] (11)
idling11 (1)
tian2992 (1)
avsilva (1)
mxchinegod (1)
zhtangsh (1)
Hari-stackroute (1)
YuriyTigiev (1)
markdev99 (1)
Icantjuddle (1)
LeCodeEst (1)
feichao93 (1)
Youssef-Harby (1)
XianYuVC (1)

Pull Request Authors

ObservedObserver (40)
dependabot[bot] (35)
islxyqwe (6)
shizakhalidi (3)
jojocys (2)
Vinfall (1)
Hamish-Leahy (1)
yomalbalooshi (1)
zakharovvladimir (1)
Yang-yibu (1)
Hephaest (1)

Top Labels

Issue Labels

todo :spiral_notepad: (11) enhancement (6) bug (3) documentation (2) P4 (1) P3 (1) Lab (1)

Pull Request Labels

dependencies (35) codex (2) enhancement (1)

Packages

Total packages: 2
Total downloads: unknown

Total dependent packages: 0
(may contain duplicates)
Total dependent repositories: 0
(may contain duplicates)
Total versions: 2

proxy.golang.org: github.com/Kanaries/Rath

Documentation: https://pkg.go.dev/github.com/Kanaries/Rath#section-documentation
License: agpl-3.0
Latest release: v0.1.0
published almost 6 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 6.4%

Average: 6.6%

Dependent repos count: 6.8%

Last synced: 4 months ago

proxy.golang.org: github.com/kanaries/rath

Documentation: https://pkg.go.dev/github.com/kanaries/rath#section-documentation
License: agpl-3.0
Latest release: v0.1.0
published almost 6 years ago

Versions: 1
Dependent Packages: 0
Dependent Repositories: 0

Rankings

Dependent packages count: 6.4%

Average: 6.6%

Dependent repos count: 6.8%

Last synced: 4 months ago

Dependencies

apps/backend/package.json npm

@types/express ^4.17.1
@types/morgan ^1.7.37
body-parser ^1.19.0
express ^4.17.1
morgan ^1.9.1
ts-node ^8.4.1
typescript ^3.6.3
visual-insights ^0.3.0

apps/desktop/package.json npm

electron ^7.1.9 development
electron-builder ^22.2.0 development

apps/testServer/package.json npm

body-parser ^1.19.2
cookie-parser ^1.4.6
express ^4.17.3

package.json npm

concurrently ^4.1.2 development
yarn ^1.19.0 development

packages/connectors/package.json npm

@types/jsonwebtoken ^8.5.5 development
@types/koa ^2.13.4 development
@types/koa__cors ^3.0.3 development
@types/koa__router ^8.0.8 development
@types/node ^16.10.1 development
ts-node ^10.2.1 development
typescript ^4.4.3 development
@koa/cors ^3.1.0
@koa/router ^10.1.1
axios ^0.21.4
jsonwebtoken ^8.5.1
koa ^2.13.3
koa-body ^4.2.0
mysql2 ^2.3.0

packages/data-prep/package.json npm

@types/react ^17.0.33 development
@types/react-dom ^17.0.10 development
@typescript-eslint/eslint-plugin ^5.17.0 development
@typescript-eslint/parser ^5.17.0 development
@vitejs/plugin-react ^1.0.7 development
eslint ^8.12.0 development
eslint-plugin-react ^7.29.4 development
typescript ^4.5.4 development
vite ^2.9.0 development
@fluentui/react ^8.0.0
mobx ^6.5.0
mobx-react-lite ^3.3.0
react ^17.0.2
react-dom ^17.0.2

packages/graphic-walker/package.json npm

@rollup/plugin-typescript ^8.2.5 development
@types/react ^17.0.0 development
@types/react-dom ^17.0.0 development
@types/uuid ^8.3.1 development
@vitejs/plugin-react-refresh ^1.3.1 development
typescript ^4.3.2 development
vite ^2.4.4 development
@heroicons/react ^1.0.4
@kanaries/web-data-loader 0.1.5
autoprefixer ^10.3.5
mobx ^6.3.3
mobx-react-lite ^3.2.1
postcss ^8.3.7
re-resizable ^6.9.8
react ^17.0.2
react-beautiful-dnd ^13.1.0
react-dom ^17.0.2
react-json-view ^1.21.3
rxjs ^7.3.0
styled-components ^5.3.0
tailwindcss ^2.2.15
uuid ^8.3.2
vega ^5.22.1
vega-embed ^6.20.8
vega-lite ^5.2.0
visual-insights 0.7.15

packages/rath-client/package.json npm

@testing-library/jest-dom ^5.11.8 development
@testing-library/react ^11.2.3 development
@testing-library/user-event ^12.6.0 development
@types/chroma-js ^1.4.3 development
@types/jest ^26.0.20 development
@types/node ^12.19.12 development
@types/react ^17.0.2 development
@types/react-beautiful-dnd ^13.0.0 development
@types/react-dom ^17.0.1 development
@types/styled-components ^5.1.7 development
source-map-explorer ^2.5.2 development
typescript ^4.8.0-dev.20220630 development
@emotion/react ^11.4.1
@emotion/styled ^11.3.0
@kanaries/graphic-walker 0.1.0
@kanaries/web-data-loader 0.1.7
@material-ui/core ^5.0.0-beta.5
@uifabric/icons ^7.5.17
@uifabric/react-hooks ^7.13.9
ali-react-table ^2.3.1
chroma-js ^2.0.6
cube-core ^2.13.0
datalib ^1.9.2
dayjs ^1.10.7
fuse.js ^3.4.6
immer ^9.0.6
localforage ^1.10.0
mobx ^6.3.2
mobx-react-lite ^3.2.0
mobx-utils ^6.0.4
mocha ^6.2.0
office-ui-fabric-core ^11.0.1
office-ui-fabric-react ^7.185.7
re-resizable ^6.9.9
react ^17.0.1
react-app-rewired ^2.1.5
react-beautiful-dnd ^13.0.0
react-dom ^17.0.1
react-intl-universal ^2.4.2
react-json-view ^1.19.1
react-markdown ^5.0.3
react-scripts 4.0.1
rxjs 6.x
styled-components ^5.2.1
symbol-observable ^4.0.0
vega ^5.22.1
vega-embed ^6.20.8
vega-lite ^5.2.0
visual-insights 0.8.11
web-vitals ^0.2.4
worker-loader ^3.0.7

packages/rath-client/public/datasets/package.json npm

moment ^2.29.1

yarn.lock npm

2153 dependencies