https://github.com/cmudig/autoprofiler

Automatically profile dataframes in the Jupyter sidebar

https://github.com/cmudig/autoprofiler

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
    Links to: arxiv.org
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (9.5%) to scientific vocabulary

Keywords

jupyter pandas python
Last synced: 6 months ago · JSON representation

Repository

Automatically profile dataframes in the Jupyter sidebar

Basic Info
  • Host: GitHub
  • Owner: cmudig
  • License: bsd-3-clause
  • Language: Svelte
  • Default Branch: main
  • Homepage:
  • Size: 24.3 MB
Statistics
  • Stars: 366
  • Watchers: 5
  • Forks: 12
  • Open Issues: 28
  • Releases: 0
Topics
jupyter pandas python
Created almost 4 years ago · Last pushed about 2 years ago
Metadata Files
Readme Contributing License

README.md

PyPi Binder Lite

Profile your Pandas Dataframes! Autoprofiler will automatically visualize your Pandas dataframes after every execution, no extra code necessary.

Autoprofiler allows you to spend less time specifying charts and more time interacting with your data by automatically showing you profiling information like:

  • Distribution of each column
  • Sample values
  • Summary statistics

Updates profiles as your data updates

screenshot of Autoprofiler

Autoprofiler reads your current Jupyter notebook and produces profiles for the Pandas Dataframes in your memory as they change.

https://user-images.githubusercontent.com/13400543/199877605-ba50f9c8-87e5-46c9-8207-1c6496bb3b18.mov

Install

To instally locally use pip and then open jupyter lab and the extension will be running.

bash pip install -U digautoprofiler

Please note, AutoProfiler only works in JupyterLab with version >=3.x, < 4.0.0.

Try it out

To try out Autoprofiler in a hosted notebook, use one of the options below

| Jupyter Lite | Binder | | :-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------: | :------------------------------------------------------------------------------------------------------------------------------------------------: | | Lite | Binder |

Browser support: AutoProfiler has been developed and tested with Chrome.

Development Install

For development install instructions, see CONTRIBUTING.md.

If you're having install issues, see TROUBLESHOOTING.md.

Acknowledgements

Big thanks to the Rill Data team! Much of our profiler UI code is adapted from Rill Developer.

Citation

Please reference our VIS'23 paper:

bibtex @article{epperson23autoprofiler, title={Dead or Alive: Continuous Data Profiling for Interactive Data Science}, author={Will Epperson and Vaishnavi Goranla and Dominik Moritz and Adam Perer}, journal={IEEE Transactions on Visualization and Computer Graphics}, year={2023}, url={https://arxiv.org/abs/2308.03964} }

Let us know what you think! 📢

We would love to hear your feedback on how you are using AutoProfiler! Please fill out this form or email Will at willepp@cmu.edu.

Owner

  • Name: CMU Data Interaction Group
  • Login: cmudig
  • Kind: organization
  • Location: Pittsburgh, PA

People, Visualization, Analysis, Machine Learning

GitHub Events

Total
  • Watch event: 21
  • Fork event: 1
Last Year
  • Watch event: 21
  • Fork event: 1

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 254
  • Total Committers: 5
  • Avg Commits per committer: 50.8
  • Development Distribution Score (DDS): 0.02
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Will Epperson w****p@l****m 249
vaish399 8****9 2
Yuqi(Adam) Zhang 7****9 1
Yuqi(Adam) Zhang 7****n 1
Dominik Moritz d****z@g****m 1

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 66
  • Total pull requests: 52
  • Average time to close issues: 2 months
  • Average time to close pull requests: 16 days
  • Total issue authors: 12
  • Total pull request authors: 6
  • Average comments per issue: 0.58
  • Average comments per pull request: 0.62
  • Merged pull requests: 42
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • willeppy (49)
  • domoritz (4)
  • vaish399 (2)
  • mjohnson11 (2)
  • ZORAYE (1)
  • legout (1)
  • yuqizhang99 (1)
  • esther279 (1)
  • adamperer (1)
  • jbwhit (1)
  • lucas-nelson-uiuc (1)
Pull Request Authors
  • willeppy (38)
  • vaish399 (5)
  • yuqizhang99 (4)
  • annddrrea (2)
  • mbooth1287 (2)
  • domoritz (1)
Top Labels
Issue Labels
feature (24) bug (17) future (2)
Pull Request Labels

Packages

  • Total packages: 2
  • Total downloads:
    • npm 2 last-month
    • pypi 146 last-month
  • Total docker downloads: 454
  • Total dependent packages: 1
    (may contain duplicates)
  • Total dependent repositories: 2
    (may contain duplicates)
  • Total versions: 34
  • Total maintainers: 1
pypi.org: digautoprofiler

Automatically profile your pandas dataframes in jupyter lab.

  • Versions: 17
  • Dependent Packages: 0
  • Dependent Repositories: 2
  • Downloads: 146 Last month
  • Docker Downloads: 219
Rankings
Docker downloads count: 3.8%
Stargazers count: 3.8%
Average: 8.7%
Dependent packages count: 10.1%
Forks count: 11.4%
Dependent repos count: 11.6%
Downloads: 11.7%
Maintainers (1)
Last synced: 6 months ago
npmjs.org: digautoprofiler

Automatically profile your pandas dataframes in jupyter lab.

  • Versions: 17
  • Dependent Packages: 1
  • Dependent Repositories: 0
  • Downloads: 2 Last month
  • Docker Downloads: 235
Rankings
Stargazers count: 7.3%
Downloads: 9.4%
Forks count: 10.8%
Average: 13.8%
Dependent packages count: 16.2%
Dependent repos count: 25.3%
Maintainers (1)
Last synced: 6 months ago