Data

Tools

Indexes

Applications

Experiments

Open Source Science

OpenMSIStream

OpenMSIStream: A Python package for facilitating integration of streaming data in diverse laboratory environments - Published in JOSS (2023)

https://github.com/openmsi/openmsistream

Science Score: 95.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ✓
    DOI references
    Found 6 DOI reference(s) in README and JOSS metadata
  • ✓
    Academic publication links
    Links to: joss.theoj.org
  • ✓
    Committers with academic emails
    3 of 6 committers (50.0%) from academic institutions
  • ○
    Institutional organization owner
  • ✓
    JOSS paper metadata
    Published in Journal of Open Source Software
Last synced: 6 months ago · JSON representation

Repository

Materials data streaming applications, written in Python using Apache Kafka, with a focus on deployment in laboratory environments

Basic Info
  • Host: GitHub
  • Owner: openmsi
  • License: gpl-3.0
  • Language: Python
  • Default Branch: main
  • Size: 12.9 MB
Statistics
  • Stars: 9
  • Watchers: 3
  • Forks: 4
  • Open Issues: 6
  • Releases: 65
Created over 3 years ago · Last pushed 7 months ago
Metadata Files
Readme License

README.md

OpenMSIStream

Maggie Eminizer1, Sam Tabrisky2,3,4, Amir Sharifzadeh1, Christopher DiMarco4, Jacob M. Diamond4,6, K.T. Ramesh4, Todd C. Hufnagel4,5,6, Tyrel M. McQueen4,5,7,8, David Elbert1,4

1 Institute for Data Intensive Engineering and Science (IDIES), The Johns Hopkins University, Baltimore, MD, USA
2 Department of Biology, Dartmouth College, Hanover, NH, USA
3 Department of Computer Science, Dartmouth College, Hanover, NH, USA
4 Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, Baltimore, MD, USA
5 Department of Materials Science and Engineering, The Johns Hopkins University, Baltimore, MD, USA
6 Department of Mechanical Engineering, The Johns Hopkins University, Baltimore, MD, USA
7 Department of Chemistry, The Johns Hopkins University, Baltimore, MD, USA
8 Institute for Quantum Matter (IQM), William H. Miller III Department of Physics and Astronomy, The Johns Hopkins University, Baltimore, MD, USA



JOSS DOI PyPI License PyPI - Python Version CircleCI Documentation Status linting: pylint

Applications for laboratory, analysis, and computational materials data streaming using Apache Kafka

Available on PyPI at https://pypi.org/project/openmsistream and GitHub at https://github.com/openmsi/openmsistream

Official documentation at https://openmsistream.readthedocs.io/en/latest/

Developed for Open MSI (NSF DMREF award #1921959); published in the Journal of Open Source Software

Owner

  • Name: Open MSI
  • Login: openmsi
  • Kind: organization
  • Email: elbert@jhu.edu

NSF DMREF award #1921959 Workspace

JOSS Publication

OpenMSIStream: A Python package for facilitating integration of streaming data in diverse laboratory environments
Published
March 09, 2023
DOI
Volume 8, Issue 83, Page 4896
Authors
Margaret Eminizer ORCID
Institute for Data Intensive Engineering and Science (IDIES), The Johns Hopkins University, USA
Sam Tabrisky
Department of Biology, Dartmouth College, USA, Department of Computer Science, Dartmouth College, USA, Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, USA
Amir Sharifzadeh ORCID
Institute for Data Intensive Engineering and Science (IDIES), The Johns Hopkins University, USA
Christopher DiMarco ORCID
Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, USA
Jacob M. Diamond ORCID
Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, USA, Department of Mechanical Engineering, The Johns Hopkins University, USA
K.t. Ramesh ORCID
Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, USA
Todd C. Hufnagel ORCID
Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, USA, Department of Materials Science and Engineering, The Johns Hopkins University, USA, Department of Mechanical Engineering, The Johns Hopkins University, USA
Tyrel M. McQueen ORCID
Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, USA, Department of Materials Science and Engineering, The Johns Hopkins University, USA, Department of Chemistry, The Johns Hopkins University, USA, Institute for Quantum Matter (IQM), William H. Miller III Department of Physics and Astronomy, The Johns Hopkins University, USA
David Elbert ORCID
Institute for Data Intensive Engineering and Science (IDIES), The Johns Hopkins University, USA, Hopkins Extreme Materials Institute (HEMI), The Johns Hopkins University, USA
Editor
Amy Roberts ORCID
Tags
data streaming science data Apache Kafka materials science
View PDF Review Thread Software Archive

GitHub Events

Total
  • Create event: 28
  • Issues event: 7
  • Release event: 29
  • Delete event: 15
  • Issue comment event: 59
  • Push event: 38
  • Pull request review comment event: 5
  • Pull request review event: 10
  • Pull request event: 28
  • Fork event: 1
Last Year
  • Create event: 28
  • Issues event: 7
  • Release event: 29
  • Delete event: 15
  • Issue comment event: 59
  • Push event: 38
  • Pull request review comment event: 5
  • Pull request review event: 10
  • Pull request event: 28
  • Fork event: 1

Committers

Last synced: 7 months ago

All Time
  • Total Commits: 651
  • Total Committers: 6
  • Avg Commits per committer: 108.5
  • Development Distribution Score (DDS): 0.201
Past Year
  • Commits: 138
  • Committers: 5
  • Avg Commits per committer: 27.6
  • Development Distribution Score (DDS): 0.457
Top Committers
Name Email Commits
Maggie Eminizer m****r@g****m 520
Tyrel M. McQueen t****s@g****m 82
David Elbert e****t@j****u 29
Kacper Kowalik (Xarthisius) x****k@g****m 16
Haochen Pan h****n@u****u 2
Daniel S. Katz d****z@i****g 2
Committer Domains (Top 20 + Academic)
ieee.org: 1 uchicago.edu: 1 jhu.edu: 1 github.com: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 13
  • Total pull requests: 84
  • Average time to close issues: 2 days
  • Average time to close pull requests: 3 days
  • Total issue authors: 6
  • Total pull request authors: 6
  • Average comments per issue: 0.54
  • Average comments per pull request: 1.15
  • Merged pull requests: 80
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 7
  • Pull requests: 27
  • Average time to close issues: about 3 hours
  • Average time to close pull requests: 7 days
  • Issue authors: 4
  • Pull request authors: 5
  • Average comments per issue: 0.14
  • Average comments per pull request: 3.07
  • Merged pull requests: 23
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • davidelbert (4)
  • lucask07 (2)
  • tmcqueen-materials (2)
  • SergeyYakubov (2)
  • pcauchy1 (2)
  • arachid1 (1)
Pull Request Authors
  • eminizer (55)
  • Xarthisius (16)
  • tmcqueen-materials (13)
  • davidelbert (4)
  • haochenpan (2)
  • danielskatz (1)
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 259 last-month
  • Total dependent packages: 0
  • Total dependent repositories: 1
  • Total versions: 58
  • Total maintainers: 2
pypi.org: openmsistream

Python applications for materials data streaming using Apache Kafka. Developed for Open MSI (NSF DMREF award #1921959)

  • Versions: 58
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 259 Last month
Rankings
Dependent packages count: 10.1%
Downloads: 11.2%
Average: 16.7%
Forks count: 19.1%
Dependent repos count: 21.5%
Stargazers count: 21.6%
Maintainers (2)
meminizer davidelbert
Last synced: 6 months ago

Dependencies

setup.py pypi
  • atomicwrites >=1.4.1
  • boto3 >=1.23.0
  • confluent-kafka >=1.9.0
  • kafkacrypto >=0.9.10.0
  • matplotlib *
  • methodtools *
  • msgpack *
.github/workflows/publish_pypi_and_dockerhub.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v4 composite
  • docker/build-push-action v4 composite
  • docker/login-action 65b78e6e13532edd9afa3aa52ac7964289d1a9c1 composite
  • docker/metadata-action v4 composite
docker/openmsistream/Dockerfile docker
  • python 3.9-slim-bullseye build
docker/openmsistream-ci/Dockerfile docker
  • python 3.9-slim-bullseye build
test/local-girder-docker-compose.yml docker
  • mongo 3.6
  • wholetale/girder latest
test/local-kafka-broker-docker-compose.yml docker
  • confluentinc/cp-kafka 7.3.0
  • confluentinc/cp-zookeeper 7.3.0
pyproject.toml pypi
requirements.txt pypi