OnlineStats.jl

OnlineStats.jl: A Julia package for statistics on data streams - Published in JOSS (2020)

https://github.com/joshday/onlinestats.jl

Science Score: 95.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
    Found 4 DOI reference(s) in README and JOSS metadata
  • Academic publication links
    Links to: joss.theoj.org
  • Committers with academic emails
    5 of 41 committers (12.2%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
    Published in Journal of Open Source Software

Keywords

big-data julia julia-language julialang online-algorithms onlinestats statistics stochastic-approximation streaming-data

Keywords from Contributors

fluxes the-human-brain graphics physics optim optimisation unconstrained-optimisation unconstrained-optimization scientific-reports literate-programming
Last synced: 6 months ago · JSON representation

Repository

⚡ Single-pass algorithms for statistics

Basic Info
Statistics
  • Stars: 876
  • Watchers: 22
  • Forks: 67
  • Open Issues: 22
  • Releases: 72
Topics
big-data julia julia-language julialang online-algorithms onlinestats statistics stochastic-approximation streaming-data
Created about 11 years ago · Last pushed 6 months ago
Metadata Files
Readme Funding License

README.md

Online Algorithms for Statistics, Models, and Big Data Viz

  • ⚡ High-performance single-pass algorithms for statistics and data viz.
  • ➕ Updated one observation at a time.
  • ✅ Algorithms use O(1) memory.
  • 📈 Perfect for streaming and big data.

| Docs | Build | Test | Citation | Dependents | |:-----|:------|:-----|----------|------------| | | Build status | codecov | DOI | deps |


🚀 Quickstart

```julia import Pkg

Pkg.add("OnlineStats")

using OnlineStats

Create several statistics

o = Series(Mean(), Variance(), Extrema())

Update with single data point

fit!(o, 1.0)

Iterate through and update with lots of data

fit!(o, randn(10^6))

Get the values of the statistics

value(o) # (value(mean), value(variance), value(extrema)) ```

📖 Documentation


✨ Contributing

  • Pull requests are very welcome!
  • For major changes, you'll probably want to first discuss the changes via issue/email/slack with @joshday.


✏️ Authors

See also the list of contributors to OnlineStats.

Owner

  • Name: Josh Day
  • Login: joshday
  • Kind: user
  • Location: Carrboro, NC
  • Company: @JuliaComputing

Researcher/Developer. Stats PhD. #JuliaLang #OpenSource

JOSS Publication

OnlineStats.jl: A Julia package for statistics on data streams
Published
February 11, 2020
Volume 5, Issue 46, Page 1816
Authors
Josh Day ORCID
Loon Analytics, LLC
Hua Zhou ORCID
UCLA Biostatistics
Editor
Karthik Ram ORCID
Tags
statistics big data online algorithms streaming data

GitHub Events

Total
  • Create event: 2
  • Commit comment event: 3
  • Release event: 1
  • Issues event: 3
  • Watch event: 37
  • Issue comment event: 11
  • Push event: 12
  • Pull request event: 11
  • Fork event: 4
Last Year
  • Create event: 2
  • Commit comment event: 3
  • Release event: 1
  • Issues event: 3
  • Watch event: 37
  • Issue comment event: 11
  • Push event: 12
  • Pull request event: 11
  • Fork event: 4

Committers

Last synced: 7 months ago

All Time
  • Total Commits: 2,431
  • Total Committers: 41
  • Avg Commits per committer: 59.293
  • Development Distribution Score (DDS): 0.085
Past Year
  • Commits: 6
  • Committers: 5
  • Avg Commits per committer: 1.2
  • Development Distribution Score (DDS): 0.667
Top Committers
Name Email Commits
Josh Day e****y@g****m 2,224
Thomas Breloff t****m@b****m 78
Josh Day j****2@n****u 56
github-actions[bot] 4****] 20
Hua Zhou h****u@n****u 4
David Widmann d****b@d****e 3
Mauro Werder m****c@r****m 3
brucala b****a@g****m 3
gdkrmr g****r@b****e 2
ExpandingMan E****n 2
Scott Lundberg s****g@g****m 2
Steffen Ridderbusch s****n@r****k 2
Tamas K. Papp t****p@g****m 2
femtocleaner[bot] f****] 2
joshday j****y@J****m 2
Graham Smith g****s@g****m 1
Hua Zhou h****u@u****u 1
Joao Aparicio j****o@g****m 1
Julia TagBot 5****t 1
Jun Tian f****y@f****m 1
Sam o****e@g****m 1
Takafumi Arakaki t****a@g****m 1
Tomáš Drvoštěp t****p@g****m 1
Tony Kelman t****y@k****t 1
WooKyoung Noh w****h@g****m 1
abhro 5****o 1
alesasse 4****e 1
dependabot[bot] 4****] 1
Rodrigo Chang r****p 1
pshashk p****h@l****u 1
and 11 more...

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 80
  • Total pull requests: 56
  • Average time to close issues: about 2 months
  • Average time to close pull requests: 5 days
  • Total issue authors: 50
  • Total pull request authors: 24
  • Average comments per issue: 2.81
  • Average comments per pull request: 1.18
  • Merged pull requests: 44
  • Bot issues: 0
  • Bot pull requests: 27
Past Year
  • Issues: 3
  • Pull requests: 9
  • Average time to close issues: about 11 hours
  • Average time to close pull requests: 17 days
  • Issue authors: 2
  • Pull request authors: 5
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.44
  • Merged pull requests: 5
  • Bot issues: 0
  • Bot pull requests: 2
Top Authors
Issue Authors
  • schlichtanders (10)
  • yakir12 (6)
  • baggepinnen (4)
  • joshday (3)
  • kolia (2)
  • hv10 (2)
  • jangevaare (2)
  • CarloLucibello (2)
  • adienes (2)
  • femtotrader (2)
  • robertfeldt (2)
  • xiaodaigh (2)
  • adknudson (2)
  • NAThompson (1)
  • olemaiwald (1)
Pull Request Authors
  • github-actions[bot] (25)
  • hv10 (3)
  • brucala (3)
  • ExpandingMan (2)
  • Crown421 (2)
  • mkitti (2)
  • Tortar (2)
  • dependabot[bot] (2)
  • abhro (2)
  • JuliaTagBot (1)
  • robertfeldt (1)
  • JoaoAparicio (1)
  • visr (1)
  • findmyway (1)
  • lyon-fnal (1)
Top Labels
Issue Labels
Pull Request Labels
dependencies (2) github_actions (2)

Packages

  • Total packages: 1
  • Total downloads:
    • julia 474 total
  • Total dependent packages: 30
  • Total dependent repositories: 13
  • Total versions: 46
juliahub.com: OnlineStats

⚡ Single-pass algorithms for statistics

  • Versions: 46
  • Dependent Packages: 30
  • Dependent Repositories: 13
  • Downloads: 474 Total
Rankings
Stargazers count: 0.5%
Forks count: 1.4%
Average: 1.8%
Dependent repos count: 2.5%
Dependent packages count: 2.8%
Last synced: 6 months ago