Data

Tools

Indexes

Applications

Experiments

Open Source Science

goes2go

Download and process GOES-16 and GOES-17 data from NOAA's archive on AWS using Python.

https://github.com/blaylockbk/goes2go

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: zenodo.org
  • ○
    Committers with academic emails
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (14.0%) to scientific vocabulary

Keywords

big-data-program download glm goes goes-16 goes-17 goes-satellite netcdf noaa-satellite open-data python satellite satellite-data satellite-imagery xarray

Keywords from Contributors

weather mesonet mesowest polars synoptic-api
Last synced: 6 months ago · JSON representation

Repository

Download and process GOES-16 and GOES-17 data from NOAA's archive on AWS using Python.

Basic Info
Statistics
  • Stars: 234
  • Watchers: 12
  • Forks: 42
  • Open Issues: 35
  • Releases: 12
Topics
big-data-program download glm goes goes-16 goes-17 goes-satellite netcdf noaa-satellite open-data python satellite satellite-data satellite-imagery xarray
Created over 5 years ago · Last pushed 9 months ago
Metadata Files
Readme License Citation

README.md

<div align="center"

Download and display GOES-East and GOES-West data

Conda Version DOI

Ruff Tests (Python) Documentation Status Python Conda Recipe Conda Downloads Conda Platforms

GOES-East and GOES-West satellite data are made available on Amazon Web Services through NOAA's Open Data Dissemination Program. GOES-2-go is a python package that makes it easy to find and download the files you want from AWS to your local computer with some additional helpers to visualize and understand the data.


GOES-2-go Documentation


Installation

The easiest way to install goes2go and its dependencies is with Conda from conda-forge.

conda install -c conda-forge goes2go

You may also create the provided Conda environment, environment.yml.

```bash

Download environment file

wget https://github.com/blaylockbk/goes2go/raw/main/environment.yml

Modify that file if you wish.

Create the environment

conda env create -f environment.yml

Activate the environment

conda activate goes2go ```

Alternatively, goes2go is published on PyPI and you can install it with pip, but it requires some additional dependencies that you will have to install yourself:

When those are installed within your environment, then you can install GOES-2-go with pip.

```bash

Latest published version

pip install goes2go

~~ or ~~

Most recent changes

pip install git+https://github.com/blaylockbk/goes2go.git ```

Capabilities

```mermaid graph TD; aws16[(AWS\nnoaa-goes16)] -.-> G aws17[(AWS\nnoaa-goes17)] -.-> G aws18[(AWS\nnoaa-goes18)] -.-> G G((. GOES 2-go .)) G --- .latest G --- .nearesttime G --- .timerange .latest --> ds[(xarray.DataSet)] .nearesttime --> ds[(xarray.DataSet)] .timerange --> ds[(xarray.DataSet)] ds --- rgb[ds.rgb\naccessor to make RGB composites] ds --- fov[ds.FOV\naccessor to get field-of-view polygons]

  style G fill:#F8AF22,stroke:#259DD7,stroke-width:4px,color:#000000

```

Download Data

Download GOES ABI or GLM NetCDF files to your local computer. Files can also be read with xarray.

First, create a GOES object to specify the satellite, data product, and domain you are interested in. The example below downloads the Multi-Channel Cloud Moisture Imagery for CONUS.

```python from goes2go import GOES

ABI Multi-Channel Cloud Moisture Imagry Product

G = GOES(satellite=16, product="ABI-L2-MCMIP", domain='C')

Geostationary Lightning Mapper

G = GOES(satellite=17, product="GLM-L2-LCFA", domain='C')

ABI Level 1b Data

G = GOES(satellite=17, product="ABI-L1b-Rad", domain='F') ```

A complete listing of the products available are available here.

There are methods to do the following:

  • List the available files for a time range
  • Download data to your local drive for a specified time range
  • Read the data into an xarray Dataset for a specific time

python # Produce a pandas DataFrame of the available files in a time range df = G.df(start='2022-07-04 01:00', end='2022-07-04 01:30')

python # Download and read the data as an xarray Dataset nearest a specific time ds = G.nearesttime('2022-01-01')

python # Download and read the latest data as an xarray Dataset ds = G.latest()

```python # Download data for a specified time range G.timerange(start='2022-06-01 00:00', end='2022-06-01 01:00')

# Download recent data for a specific interval G.timerange(recent='30min') ```

RGB Recipes

The rgb xarray accessor computes various RGB products from a GOES ABI ABI-L2-MCMIP (multi-channel cloud and moisture imagry products) xarray.Dataset. See the demo for more examples of RGB products.

python import matplotlib.pyplot as plt ds = GOES().latest() ax = plt.subplot(projection=ds.rgb.crs) ax.imshow(ds.rgb.TrueColor(), **ds.rgb.imshow_kwargs) ax.coastlines()

Field of View

The FOV xarray accessor creates shapely.Polygon objects for the ABI and GLM field of view. See notebooks for GLM and ABI field of view.

```python from goes2go.data import goeslatest G = goeslatest()

Get polygons of the full disk or ABI domain field of view.

G.FOV.full_disk G.FOV.domain

Get Cartopy coordinate reference system

G.FOV.crs ```

GOES-West is centered over -137 W and GOES-East is centered over -75 W. When GOES was being tested, it was in a "central" position, outlined in the dashed black line. Below is the ABI field of view for the full disk: field of view image

The GLM field of view is slightly smaller and limited by a bounding box. Below is the approximated GLM field of view: field of view image

How to Cite and Acknowledge

If GOES-2-go played an important role in your work, please tell me about it! Also, consider including a citation or acknowledgement in your article or product.

Suggested Citation

Blaylock, B. K. (2023). GOES-2-go: Download and display GOES-East and GOES-West data (Version 2022.07.15) [Computer software]. https://github.com/blaylockbk/goes2go

Suggested Acknowledgment

A portion of this work used code generously provided by Brian Blaylock's GOES-2-go python package (https://github.com/blaylockbk/goes2go)

What if I don't like the GOES-2-go or Python?

As an alternative you can use rclone to download GOES files from AWS. I quite like rclone. Here is a short rclone tutorial.

I hope you find this makes GOES data easier to retrieve and display. Enjoy!

- Brian Blaylock

Contributing Guidelines
GitHub Discussions
GitHub Issues
Personal Webpage

P.S. If you like GOES-2-go, check out my other python packages

  • Herbie: download numerical weather model data
  • SynopticPy: retrieve mesonet data from the Synoptic API.
  • Pandas-rose: easly wind rose from Pandas dataframe.

Related Content

Owner

  • Name: Brian Blaylock
  • Login: blaylockbk
  • Kind: user
  • Location: Monterey, CA

Meteorologist

GitHub Events

Total
  • Create event: 2
  • Issues event: 8
  • Release event: 1
  • Watch event: 35
  • Issue comment event: 21
  • Push event: 15
  • Pull request event: 10
  • Fork event: 9
Last Year
  • Create event: 2
  • Issues event: 8
  • Release event: 1
  • Watch event: 35
  • Issue comment event: 21
  • Push event: 15
  • Pull request event: 10
  • Fork event: 9

Committers

Last synced: 7 months ago

All Time
  • Total Commits: 383
  • Total Committers: 13
  • Avg Commits per committer: 29.462
  • Development Distribution Score (DDS): 0.089
Past Year
  • Commits: 53
  • Committers: 8
  • Avg Commits per committer: 6.625
  • Development Distribution Score (DDS): 0.472
Top Committers
Name Email Commits
Brian Blaylock b****k@g****m 349
Isaac Barlet i****t@l****m 13
ifscript 1****t 6
Brian Blaylock b****r@n****l 4
Bryan Guarente 3****e 2
Cedric Sam c****m@g****m 2
Filipe Fernandes o****f@g****m 1
Martin Cuahutle Cuahutle 6****e 1
Ry r****3@g****m 1
Santiago Monserrat Campanello s****r@h****m 1
The Gitter Badger b****r@g****m 1
coliveir-aer 7****r 1
Oli McCormack o****i@t****o 1
Committer Domains (Top 20 + Academic)
tothelee.co: 1 gitter.im: 1 nrlmry.navy.mil: 1 linevisioninc.com: 1

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 67
  • Total pull requests: 27
  • Average time to close issues: 29 days
  • Average time to close pull requests: 3 days
  • Total issue authors: 41
  • Total pull request authors: 12
  • Average comments per issue: 1.31
  • Average comments per pull request: 1.0
  • Merged pull requests: 24
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 10
  • Pull requests: 11
  • Average time to close issues: about 3 hours
  • Average time to close pull requests: 5 days
  • Issue authors: 8
  • Pull request authors: 6
  • Average comments per issue: 0.7
  • Average comments per pull request: 1.09
  • Merged pull requests: 8
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • blaylockbk (22)
  • csteele2 (3)
  • DirkMPetersen (2)
  • thomasdewitt (2)
  • EmanuelCastanho (2)
  • jamesmhbarry (1)
  • w-k-jones (1)
  • scottthomaswx (1)
  • bryanguarente (1)
  • williamhobbs (1)
  • nrchade (1)
  • john-a-m (1)
  • zmcfire (1)
  • ilmesi (1)
  • santimc (1)
Pull Request Authors
  • blaylockbk (10)
  • ibarlet (4)
  • santimc (2)
  • bryanguarente (2)
  • mcuahutle (2)
  • cedricsam (2)
  • tetrahedrl (2)
  • ifscript (2)
  • gitter-badger (1)
  • ocefpaf (1)
  • coliveir-aer (1)
  • olimcc (1)
Top Labels
Issue Labels
help wanted (4) bug (3) install (3) enhancement (3) documentation (1) need more info (1)
Pull Request Labels

Packages

  • Total packages: 2
  • Total downloads:
    • pypi 1,629 last-month
  • Total docker downloads: 35
  • Total dependent packages: 1
    (may contain duplicates)
  • Total dependent repositories: 1
    (may contain duplicates)
  • Total versions: 14
  • Total maintainers: 1
pypi.org: goes2go

Retrieve GOES Satellite data from AWS. Also proves some RGB recipes.

  • Homepage: https://github.com/blaylockbk/goes2go
  • Documentation: https://goes2go.readthedocs.io/
  • License: MIT License Copyright (c) 2019-2022 Brian Blaylock Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
  • Latest release: 2025.2.0
    published about 1 year ago
  • Versions: 13
  • Dependent Packages: 1
  • Dependent Repositories: 1
  • Downloads: 1,629 Last month
  • Docker Downloads: 35
Rankings
Stargazers count: 6.1%
Dependent packages count: 7.4%
Forks count: 7.8%
Average: 11.1%
Downloads: 12.0%
Dependent repos count: 22.2%
Maintainers (1)
blaylockbk
Last synced: 6 months ago
conda-forge.org: goes2go

GOES-East and GOES-West satellite data are made available on Amazon Web Services through NOAA's Big Data Program. `goes2go` is a python package that makes it easy to find and download the files you need to your local computer. Some additional helpers are provided that make working with GOES data easy and fun, such as recipes for RGB composites.

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 0
Rankings
Dependent repos count: 9.3%
Average: 33.1%
Stargazers count: 33.7%
Forks count: 37.2%
Dependent packages count: 52.4%
Last synced: 6 months ago

Dependencies

.github/workflows/release_to_pypi.yml actions
.github/workflows/tests-python.yml actions