hagelslag

Hagelslag supports segmentation and tracking of weather fields and scalable verification, including performance diagrams and reliability diagrams.

https://github.com/djgagne/hagelslag

Science Score: 23.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
  • .zenodo.json file
  • DOI references
    Found 2 DOI reference(s) in README
  • Academic publication links
  • Committers with academic emails
    11 of 20 committers (55.0%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (15.7%) to scientific vocabulary

Keywords

geojson hail hrrr machine-learning mrms netcdf performance performance-diagram python reliability segmentation storms tracking verification weather zarr

Keywords from Contributors

atmospheric-science
Last synced: 5 months ago · JSON representation

Repository

Hagelslag supports segmentation and tracking of weather fields and scalable verification, including performance diagrams and reliability diagrams.

Basic Info
  • Host: GitHub
  • Owner: djgagne
  • License: mit
  • Language: Jupyter Notebook
  • Default Branch: master
  • Homepage:
  • Size: 91.3 MB
Statistics
  • Stars: 71
  • Watchers: 16
  • Forks: 25
  • Open Issues: 6
  • Releases: 4
Topics
geojson hail hrrr machine-learning mrms netcdf performance performance-diagram python reliability segmentation storms tracking verification weather zarr
Created over 10 years ago · Last pushed about 2 years ago
Metadata Files
Readme License

README.md

Hagelslag

Storm tracking, machine learning, and probabilistic evaluation

NSF-1261776

Hagelslag is an object-based severe storm forecasting system that utilizing image processing and machine learning tools to derive calibrated probabilities of severe hazards from convection-allowing numerical weather prediction model output. The package contains modules for storm identification and tracking, spatio-temporal data extraction, and machine learning model training to predict hazard intensity as well as space and time translations.

Citation

If you employ hagelslag in your research, please acknowledge its use with the following citations:

Gagne, D. J., A. McGovern, S. E. Haupt, R. A. Sobash, J. K. Williams, M. Xue, 2017: Storm-Based Probabilistic Hail
Forecasting with Machine Learning Applied to Convection-Allowing Ensembles, Wea. Forecasting, 32, 1819-1840. 
https://doi.org/10.1175/WAF-D-17-0010.1. 

Gagne II, D. J., A. McGovern, N. Snook, R. Sobash, J. Labriola, J. K. Williams, S. E. Haupt, and M. Xue, 2016: 
Hagelslag: Scalable object-based severe weather analysis and forecasting. Proceedings of the Sixth Symposium on 
Advances in Modeling and Analysis Using Python, New Orleans, LA, Amer. Meteor. Soc., 447.

If you discover any issues, please post them to the Github issue tracker page. Questions and comments should be sent to djgagne at ou dot edu.

Requirements

Hagelslag is compatible with Python 3.6 or newer. Hagelslag is easiest to install with the help of the Miniconda Python Distribution, but it should work with other Python setups as well. Hagelslag requires the following packages and recommends the following versions:

  • numpy >= 1.10
  • scipy >= 0.15
  • matplotlib >= 1.4
  • scikit-learn >= 0.16
  • pandas >= 0.15
  • arrow >= 0.8.0
  • pyproj
  • netCDF4-python
  • xarray
  • jupyter
  • ncepgrib2
  • pygrib
  • cython
  • pip
  • sphinx
  • mock

Install dependencies with the following commands: git clone https://github.com/djgagne/hagelslag.git cd ~/hagelslag conda env create -f environment.yml conda activate hagelslag

Installation

Install the latest version of hagelslag with the following command from the top-level hagelslag directory (where setup.py is): pip install .

Hagelslag will install the libraries in site-packages and will also install 3 applications into the bin directory of your Python installation.

Use

A Jupyter notebook is located in the demos directory that showcases the functionality of the package. For larger scale use, 3 scripts are provided in the bin directory.

  • hsdata performs object tracking and matching as well as data processing.
  • hsfore trains and applies machine learning models.
  • hseval performs forecast verification.

All scripts take input from a config file. The config file should be valid Python code and contain a dictionary called config. Custom machine learning models and parameters should be contained within the config files. Examples of them can be found in the config directory.

Documentation

API Documentation is available here.

Owner

  • Name: David John Gagne
  • Login: djgagne
  • Kind: user
  • Location: Boulder, CO
  • Company: NSF National Center for Atmospheric Research

Machine Learning Scientist II and head of the Machine Integration and Learning for Earth Systems group at the NSF National Center for Atmospheric Research.

GitHub Events

Total
  • Watch event: 4
Last Year
  • Watch event: 4

Committers

Last synced: 6 months ago

All Time
  • Total Commits: 619
  • Total Committers: 20
  • Avg Commits per committer: 30.95
  • Development Distribution Score (DDS): 0.415
Past Year
  • Commits: 12
  • Committers: 3
  • Avg Commits per committer: 4.0
  • Development Distribution Score (DDS): 0.333
Top Committers
Name Email Commits
David John Gagne d****e@o****u 362
ahijevyc a****c@u****u 73
David John Gagne d****e@g****m 64
Amanda Burke a****e@n****t 35
Amanda Burke 3****e 31
Ubuntu t****o@e****t 10
Charlie Becker c****r@g****m 9
Charlie Becker 3****r 6
Amanda Burke a****e@l****u 5
Amanda Burke a****e@l****u 4
Amanda Burke a****e@l****u 3
Amanda Burke a****e@s****u 3
Kate Avery k****y@o****u 3
Nathan Wendt n****t@o****u 3
Amanda Burke a****e@d****u 2
Amanda Burke a****e@l****u 2
Thomas Martin 3****o 1
David Gagne d****e@s****u 1
Luke Madaus m****e@g****m 1
Maria J. Molina h****a@g****m 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 6
  • Total pull requests: 42
  • Average time to close issues: N/A
  • Average time to close pull requests: 19 days
  • Total issue authors: 5
  • Total pull request authors: 8
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.86
  • Merged pull requests: 40
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • ahijevyc (2)
  • kresguerra02 (1)
  • charlie-becker (1)
  • mariajmolina (1)
  • djgagne (1)
Pull Request Authors
  • djgagne (20)
  • ahijevyc (9)
  • alburke (5)
  • charlie-becker (4)
  • nawendt (2)
  • mariajmolina (1)
  • lmadaus (1)
  • ThomasMGeo (1)
Top Labels
Issue Labels
Pull Request Labels

Packages

  • Total packages: 1
  • Total downloads:
    • pypi 288 last-month
  • Total dependent packages: 1
  • Total dependent repositories: 2
  • Total versions: 5
  • Total maintainers: 1
pypi.org: hagelslag

Hagelslag is a Python package for storm-based analysis, forecasting, and evaluation.

  • Versions: 5
  • Dependent Packages: 1
  • Dependent Repositories: 2
  • Downloads: 288 Last month
Rankings
Dependent packages count: 7.3%
Forks count: 7.6%
Stargazers count: 8.4%
Dependent repos count: 11.8%
Average: 12.2%
Downloads: 26.1%
Maintainers (1)
Last synced: 6 months ago

Dependencies

requirements.txt pypi
  • arrow >=0.8
  • cython *
  • h5py *
  • matplotlib *
  • mock *
  • netcdf4 *
  • numpy >=1.18
  • pandas >=1.2
  • pygrib *
  • pyproj *
  • pytest *
  • s3fs *
  • scikit-image *
  • scikit-learn >=0.2
  • scipy *
  • sphinx *
  • xarray *
rtd_requirements.txt pypi
  • arrow >=0.8
  • matplotlib *
  • mock *
  • netcdf4 *
  • numpy *
  • pandas *
  • scikit-image *
  • scikit-learn *
  • scipy *
.github/workflows/python-package-conda.yml actions
  • actions/checkout v2 composite
  • conda-incubator/setup-miniconda v2 composite
.github/workflows/python-publish.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v3 composite
  • pypa/gh-action-pypi-publish 27b31702a0e7fc50959f5ad993c78deac1bdfc29 composite
setup.py pypi
pyproject.toml pypi
  • dask *
  • matplotlib *
  • numba *
  • numpy *
  • pandas *
  • pyarrow *
  • pygrib *
  • pyproj *
  • pyshp *
  • scikit-image *
  • scikit-learn *
  • scipy *
  • xarray *
  • zarr *
environment.yml conda
  • arrow
  • cython
  • dask
  • flake8
  • h5py
  • jasper
  • jupyter
  • jupyterlab
  • matplotlib
  • mock
  • netcdf4
  • numba
  • numpy
  • pandas
  • pip
  • pyarrow
  • pygrib
  • pyproj
  • pytest
  • python <=3.10
  • s3fs
  • scikit-image
  • scikit-learn
  • scipy
  • sphinx
  • xarray
  • zarr