Data

Tools

Indexes

Applications

Experiments

Open Source Science

cloud-ldas

https://github.com/almcnall/cloud-ldas

Science Score: 44.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (4.1%) to scientific vocabulary
Last synced: 6 months ago · JSON representation ·

Repository

Basic Info
  • Host: GitHub
  • Owner: almcnall
  • Language: Python
  • Default Branch: main
  • Size: 101 KB
Statistics
  • Stars: 0
  • Watchers: 0
  • Forks: 0
  • Open Issues: 0
  • Releases: 0
Created 8 months ago · Last pushed 8 months ago
Metadata Files
Readme Contributing Citation

README.md

FLDAS and NLDAS Cloud Storage Benchmarking

Overview

Reprocess Data Files

The reprocess script implements cloud optimization strategies:

  • Enlarge "chunks" to a size better for cloud object stores
  • Move the internal data on file structure into distinct "pages"
  • Copy the internal data on file structure to external "sidecar" files

Benchmark Zonal Statistics against Local Storage

The benchmark script opens original and reprocessed files to calculate a zonal statistic.

Contributing

The CONTRIBUTING.md file provides setup instructions and shell commands to reproduce the data included in the associated publication.

Acknowledgments

Owner

  • Login: almcnall
  • Kind: user

Citation (CITATION.cff) 

cff-version: 1.2.0
message: "Please cite the article from preferred-citation to reference this code supplement."
authors:
  - family-names: McNally
    given-names: Amy
  - family-names: Sterzinger
    given-names: Lucas
  - family-names: Carroll
    given-names: Ian
title: "Producing Earth Science Data for Impact: Improved Commercial Cloud Usability of Archive Model Data (Code Supplement)"
preferred-citation:
  authors:
    - family-names: McNally
      given-names: Amy
    - family-names: Sterzinger
      given-names: Lucas
    - family-names: Carroll
      given-names: Ian
  title: "Producing Earth Science Data for Impact: Improved Commercial Cloud Usability of Archive Model Data"
  type: article

GitHub Events

Total
  • Push event: 2
Last Year
  • Push event: 2

Dependencies

environment.yml pypi
pyproject.toml pypi
  • dask [complete]>=2025.4.0
  • earthaccess >=0.14.0
  • fsspec >=2025.3.2
  • h5netcdf >=1.6.2
  • kerchunk >=0.2.8
  • msgspec >=0.19.0
  • xarray >=2025.3.1