Data

Tools

Indexes

Applications

Experiments

Open Source Science

em27-retrieval-pipeline

automated EM27/SUN data processing

https://github.com/tum-esm/em27-retrieval-pipeline

Science Score: 57.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ✓
    DOI references
    Found 5 DOI reference(s) in README
  • ○
    Academic publication links
  • ✓
    Committers with academic emails
    2 of 7 committers (28.6%) from academic institutions
  • ✓
    Institutional organization owner
    Organization tum-esm has institutional domain (www.ei.tum.de)
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (9.5%) to scientific vocabulary
Last synced: 7 months ago · JSON representation

Repository

automated EM27/SUN data processing

Basic Info
Statistics
  • Stars: 10
  • Watchers: 2
  • Forks: 1
  • Open Issues: 1
  • Releases: 10
Created over 3 years ago · Last pushed 8 months ago
Metadata Files
Readme License Citation

README.md

EM27 Retrieval Pipeline: Automated EM27/SUN Data Processing

GitHub License GitHub Tag
Static Badge
Static Badge
Static Badge

We retrieve a lot of EM27/SUN data, produced mainly by MUCCnet (Dietrich et al., 2021), and have used this pipeline since end of 2021.

This codebase provides an automated data pipeline for Proffast 1 and 2.X. Under the hood, it uses the Proffast Pylot to interact with Proffast 2 and an in-house connector to interact with Proffast 1. Whenever using this pipeline for Proffast retrievals, please make sure to also cite Proffast and the Proffast Pylot (for Proffast 2.X retrievals).

Read the documentation at em27-retrieval-pipeline.netlify.app.
Get the source code at github.com/tum-esm/em27-retrieval-pipeline.
Report Issues or discuss enhancements using issues on GitHub.

Related Projects:

Many of our projects (including this pipeline) use functionality from the tum-esm-utils package.
Our EM27/SUN systems are running autonomously with the help of Pyra.

Owner

  • Name: TUM - Environmental Sensing and Modeling
  • Login: tum-esm
  • Kind: organization
  • Location: Germany

GitHub Events

Total
  • Create event: 19
  • Release event: 3
  • Issues event: 34
  • Watch event: 3
  • Delete event: 5
  • Issue comment event: 27
  • Push event: 61
  • Pull request review event: 19
  • Pull request review comment event: 23
  • Pull request event: 8
Last Year
  • Create event: 19
  • Release event: 3
  • Issues event: 34
  • Watch event: 3
  • Delete event: 5
  • Issue comment event: 27
  • Push event: 61
  • Pull request review event: 19
  • Pull request review comment event: 23
  • Pull request event: 8

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 1,539
  • Total Committers: 7
  • Avg Commits per committer: 219.857
  • Development Distribution Score (DDS): 0.125
Past Year
  • Commits: 300
  • Committers: 2
  • Avg Commits per committer: 150.0
  • Development Distribution Score (DDS): 0.023
Top Committers
Name Email Commits
Moritz Makowski m****z@d****v 1,346
MarlonMueller m****r@t****e 130
Vyas G v****7@g****m 26
Dmytro Polityka d****a@t****e 23
cfleur c****r 7
undernagruzez 3****z 6
ESM shared account e****m@n****l 1
Committer Domains (Top 20 + Academic)
tum.de: 2 new-esm-server-debian.novalocal: 1 dostuffthatmatters.dev: 1

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 13
  • Total pull requests: 3
  • Average time to close issues: 3 days
  • Average time to close pull requests: 1 day
  • Total issue authors: 1
  • Total pull request authors: 3
  • Average comments per issue: 0.0
  • Average comments per pull request: 2.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 13
  • Pull requests: 3
  • Average time to close issues: 3 days
  • Average time to close pull requests: 1 day
  • Issue authors: 1
  • Pull request authors: 3
  • Average comments per issue: 0.0
  • Average comments per pull request: 2.0
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • dostuffthatmatters (25)
Pull Request Authors
  • dostuffthatmatters (7)
  • cfleur (5)
  • Copilot (1)
Top Labels
Issue Labels
scope:retrieval (9) backlog (5) status:implemented (4) status:in-progress (3) status:done (3) scope:export (3) scope:profiles (2) scope:docs (1) scope:bundle (1)
Pull Request Labels
backlog (2) scope:retrieval (1)

Dependencies

.github/workflows/test.yaml actions
  • actions/cache v4 composite
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
docs/package-lock.json npm
  • 563 dependencies
docs/package.json npm
  • @types/json-schema ^7.0.11 development
  • @types/node 20.1.4 development
  • serve ^14.2.1 development
  • typescript 5.0.4 development
  • autoprefixer ^10.4.17
  • next ^13.5.6
  • nextra ^2.13.2
  • nextra-theme-docs ^2.13.2
  • postcss ^8.4.33
  • react ^18.2.0
  • react-dom ^18.2.0
  • tailwindcss ^3.3.2
  • zod ^3.22.4
pyproject.toml pypi
  • click >=8.1.7
  • em27-metadata >=1.0.0rc7
  • filelock >=3.13.1
  • fortranformat >=2.0.0
  • numpy >=1.26.3
  • pandas >=2.2.0
  • polars >=0.20.5
  • pydantic >=2.5.3
  • pytz >=2023.3.post1
  • pyyaml >=6.0.1
  • rich >=13.7.0
  • scipy >=1.11.4
  • skyfield >=1.47
  • timezonefinder >=6.2.0
  • tqdm >=4.66.1
  • tum-esm-utils >=1.8.3