cloud-sandbox

IOOS' Coastal Modeling Cloud Sandbox provides a framework for developing, modifying and running models in the cloud. It provides repeatable configurations, model code and required libraries, input data and analysis of model outputs. The Sandbox supports not only the development of services and models, but also Cloud HPC to run and validate models.

https://github.com/ioos/cloud-sandbox

Science Score: 26.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (10.7%) to scientific vocabulary
Last synced: 11 months ago · JSON representation

Repository

IOOS' Coastal Modeling Cloud Sandbox provides a framework for developing, modifying and running models in the cloud. It provides repeatable configurations, model code and required libraries, input data and analysis of model outputs. The Sandbox supports not only the development of services and models, but also Cloud HPC to run and validate models.

Basic Info
Statistics
  • Stars: 16
  • Watchers: 14
  • Forks: 19
  • Open Issues: 21
  • Releases: 1
Created over 6 years ago · Last pushed 11 months ago
Metadata Files
Readme License

README.md

IOOS Cloud Sandbox

The IOOS Cloud Sandbox is a collaborative platform for running regional coastal models in the cloud.

It provides repeatable configurations, model code and required libraries, input data, and analysis of model outputs. The Sandbox provisions Cloud HPC to aid in the development of services and models, and also supports running and validating models. The Sandbox is intended for use across industries and is inclusive to anyone who wants to develop, enhance, and run coastal models.

Use cases

  • Inter-organization collaboration
  • University graduate courses
  • Hindcasts/Reanalysis
  • Research to Operations (R2O)
  • On-demand HPC capacity
  • Quasi-operational HPC fail-over (natural disasters, data-center problems)
  • AI/ML training

Deployment options

  • Self deployed/hosted: Deploy using your own AWS cloud account
  • IOOS hosted: NOAA AWS Government Cloud – Lynker contract
  • RPS hosted: Isolated secure Virtual Private Cloud (VPC)

The Cloud Sandbox has been used to run:

I want to...

Software Stack

The Cloud Sandbox uses CloudFlow to orchestrate the execution of the model. CloudFlow is a customized workflow for running models built on Prefect Workflows.

Modeling Stack

Software Architecture

The Cloud Sandbox uses Terraform to deploy resources to the cloud. The sandbox currently only supports the Amazon Web Services (AWS) cloud platform.

  • Head Node: The head node is the machine that runs the CloudFlow scheduler. Users can SSH into this machine to run CloudFlow tasks.
  • Preconfigured AMI: This Amazon Machine Image (AMI) contains all of the necessary code to run the model. This image will run on the worker nodes.
  • Worker Nodes: The worker nodes are provisioned by Terraform and run CloudFlow tasks. This runs the preconfigured AMI.

Owner

  • Name: US Integrated Ocean Observing System
  • Login: ioos
  • Kind: organization
  • Email: data.ioos@noaa.gov
  • Location: Silver Spring, MD

Software, tools, and technical documentation supporting IOOS Data Management and Cyberinfrastructure (DMAC).

GitHub Events

Total
  • Issues event: 21
  • Watch event: 2
  • Delete event: 11
  • Issue comment event: 42
  • Push event: 70
  • Pull request review comment event: 1
  • Pull request review event: 26
  • Pull request event: 23
  • Fork event: 10
  • Create event: 18
Last Year
  • Issues event: 21
  • Watch event: 2
  • Delete event: 11
  • Issue comment event: 42
  • Push event: 70
  • Pull request review comment event: 1
  • Pull request review event: 26
  • Pull request event: 23
  • Fork event: 10
  • Create event: 18

Committers

Last synced: 11 months ago

All Time
  • Total Commits: 148
  • Total Committers: 10
  • Avg Commits per committer: 14.8
  • Development Distribution Score (DDS): 0.209
Past Year
  • Commits: 12
  • Committers: 3
  • Avg Commits per committer: 4.0
  • Development Distribution Score (DDS): 0.417
Top Committers
Name Email Commits
Patrick Tripp p****p@r****m 117
Jonathan Joyce J****e@r****m 10
ZacharyWills 6****s 6
Micah Wengren m****n@g****m 6
Jason Ducker 8****P 4
Minna Ho m****5@g****m 1
Mahmud Monim 3****M 1
Benjamin Adams b****s@r****m 1
Ubuntu u****u@i****l 1
Patrick Tripp p****p@g****m 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 11 months ago

All Time
  • Total issues: 33
  • Total pull requests: 94
  • Average time to close issues: about 1 year
  • Average time to close pull requests: 6 days
  • Total issue authors: 12
  • Total pull request authors: 14
  • Average comments per issue: 2.09
  • Average comments per pull request: 0.51
  • Merged pull requests: 75
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 10
  • Pull requests: 24
  • Average time to close issues: about 1 month
  • Average time to close pull requests: 6 days
  • Issue authors: 4
  • Pull request authors: 8
  • Average comments per issue: 0.2
  • Average comments per pull request: 0.79
  • Merged pull requests: 13
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • ZacharyWills (6)
  • Michael-Lalime (6)
  • KatherinePowell-NOAA (5)
  • mykelalvis (4)
  • breannalcv (3)
  • mwengren (3)
  • cpaternostro (1)
  • rezuma (1)
  • aliabdolali (1)
  • dpsnowden (1)
  • jduckerOWP (1)
  • hellkite500 (1)
Pull Request Authors
  • patrick-tripp (60)
  • jduckerOWP (7)
  • ZacharyWills (6)
  • jonmjoyce (5)
  • mwengren (3)
  • sakshamg19 (2)
  • kennethells (2)
  • ruhhh1130 (2)
  • nayaaaaaann (2)
  • RATED-R-SUNDRAM (1)
  • mykelalvis (1)
  • benjwadams (1)
  • minnaho (1)
  • MahmudM (1)
Top Labels
Issue Labels
LiveOcean 12-year reanalysis (1)
Pull Request Labels

Dependencies

cloudflow/plotting/requirements.txt pypi
  • Pillow *
  • cmocean *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • pyproj ==2.6
cloudflow/requirements.txt pypi
  • Pillow *
  • cmocean *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • plotting *
  • pyproj *
cloudflow/setup.py pypi
  • Pillow *
  • cmocean *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • pyproj *
setup.py pypi
  • Pillow *
  • boto3 *
  • dask *
  • distributed *
  • matplotlib *
  • netCDF4 *
  • numpy *
  • plotting *
  • prefect *
  • pyproj ==2.6
cloudflow/notebooks/requirements.txt pypi
  • boto3 *
  • cartopy ==0.20.2
  • cmocean ==2.0
  • netCDF4 *
  • netcdf4 ==1.5.8
  • numpy *
  • scipy *
  • xarray ==2022.3.0