🌏 Note: This branch contains the Australia-specific implementation of DEA Coastlines. For a more flexible implementation adapted to globally available USGS Collection 2 Level 2 Landsat data, we recommend adapting the Digital Earth Africa Coastlines implementation instead.

Digital Earth Australia Coastlines

License: The code in this repository is licensed under the Apache License, Version 2.0. Digital Earth Australia data is licensed under the Creative Commons by Attribution 4.0 license.

Contact: For assistance with any of the Python code or Jupyter Notebooks in this repository, please post a Github issue. For questions or more information about this workflow, email Robbi.BishopTaylor@ga.gov.au.

To cite:

Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. Available: https://doi.org/10.1016/j.rse.2021.112734

Nanson, R., Bishop-Taylor, R., Sagar, S., Lymburner, L., (2022). Geomorphic insights into Australia's coastal change using a national dataset derived from the multi-decadal Landsat archive. Estuarine, Coastal and Shelf Science, 265, p.107712. Available: https://doi.org/10.1016/j.ecss.2021.107712

Bishop-Taylor, R., Sagar, S., Lymburner, L., Alam, I., Sixsmith, J. (2019). Sub-pixel waterline extraction: characterising accuracy and sensitivity to indices and spectra. Remote Sensing, 11 (24):2984. Available: https://doi.org/10.3390/rs11242984

Digital Earth Australia Coastlines is a continental dataset that includes annual shorelines and rates of coastal change along the entire Australian coastline from 1988 to the present.

The product combines satellite data from Geoscience Australia's Digital Earth Australia program with tidal modelling to map the typical location of the coastline at mean sea level for each year. The product enables trends of coastal erosion and growth to be examined annually at both a local and continental scale, and for patterns of coastal change to be mapped historically and updated regularly as data continues to be acquired. This allows current rates of coastal change to be compared with that observed in previous years or decades.

The ability to map shoreline positions for each year provides valuable insights into whether changes to our coastline are the result of particular events or actions, or a process of more gradual change over time. This information can enable scientists, managers and policy makers to assess impacts from the range of drivers impacting our coastlines and potentially assist planning and forecasting for future scenarios.

Applications

• Monitoring and mapping rates of coastal erosion along the Australian coastline
• Prioritise and evaluate the impacts of local and regional coastal management based on historical coastline change
• Modelling how coastlines respond to drivers of change, including extreme weather events, sea level rise or human development
• Supporting geomorphological studies of how and why coastlines have changed across time

Table of contents

• Digital Earth Australia Coastlines
  • Applications
    • Table of contents
    • Repository code
  • Getting started
    • Setting up global ocean tide models
  • Python modules
  • Jupyter notebooks
    • Running a DEA Coastlines analysis using the command-line interface (CLI)
  • Analysis outputs
    • Data access
  • Data download
  • Interactive map
  • Loading DEA Coastlines data from the Web Feature Service (WFS) using Python
    • Loading DEA Coastlines data from the Web Feature Service (WFS) using R
  • Jupyter Notebook
    • Credits
    • References

Repository code

The code in this repository is built on the Digital Earth Australia implementation of the Open Data Cube software for accessing, managing, and analyzing large quantities of Earth observation (EO) data. The code currently runs on the Digital Earth Australia Sandbox infrastructure.

Getting started

Clone the dea-coastlines repository and checkout the develop branch: git clone https://github.com/GeoscienceAustralia/dea-coastlines.git git checkout --track origin/develop

Setting up global ocean tide models

Tide modelling is a core part of the DEA Coastlines workflow. DEA Coastlines can be run using any global ocean tide model supported by the eo-tides and pyTMD Python packages, including:

• Empirical Ocean Tide model (EOT20)
• Finite Element Solution tide models (FES2022, FES2014, FES2012)
• TOPEX/POSEIDON global tide models (TPXO10, TPXO9, TPXO8)
• Global Ocean Tide models (GOT5.6, GOT5.5, GOT4.10, GOT4.8, GOT4.7)
• Hamburg direct data Assimilation Methods for Tides models (HAMTIDE11)
• Technical University of Denmark tide models (DTU23)

For detailed instructions on setting up tide models, follow the [Setting up tidal models guide](https://github.com/GeoscienceAustralia/dea-coastlines/wiki/Setting-up-tidal-models-for-DEA-Coastlines.

Python modules

Code in this repository is included in the coastlines Python package which contains three main modules. These are intended to be run in the following order:

1. coastlines.raster: This module conducts raster generation for DEA Coastlines. This analysis is processed on individual study area tiles to minimise peak memory usage.

* Load stack of all available Landsat 5, 7, 8 and 9 satellite imagery for a location using [ODC Virtual Products](https://docs.dea.ga.gov.au/notebooks/Frequently_used_code/Virtual_products.html)
* Convert each satellite image into a remote sensing water index (e.g. MNDWI)
* For each satellite image, model ocean tides into a tidal modelling grid based on exact time of image acquisition
* Interpolate tide heights into spatial extent of image stack
* Mask out high and low tide pixels by removing all observations acquired outside of 50 percent of the observed tidal range centered over mean sea level
* Combine tidally-masked data into annual median composites representing the most representative position of the shoreline at approximately mean sea level each year

1. coastlines.vector: This module conducts vector subpixel coastline extraction and rates of change statistics calculation. This analysis is processed on individual study area tiles to minimise peak memory usage.

* Apply morphological extraction algorithms to mask annual median composite rasters to a valid coastal region
* Extract shoreline vectors using subpixel waterline extraction ([Bishop-Taylor et al. 2019b](https://doi.org/10.3390/rs11242984))
* Compute rates of coastal change at every 30 m along the coastline using linear regression

1. coastlines.continental: This module combines tiled layers into seamless continental-scale vector files:

* Combines multiple output shoreline and rates of change statistics point vectors into single continental datasets
* Aggregates this data to produce moving window coastal change hotspot datasets that summarise coastal change at regional and continental scale.

Jupyter notebooks

An interactive walk-through of each step of the tiled raster and vector DEA Coastlines workflow and the continental layer generation is provided in the following Jupyter Notebooks. These notebooks can be run on the DEA Sandbox to assist in prototyping or troubleshooting: * DEA Coastlines raster generation * DEA Coastlines vector generation * DEA Coastlines continental hotspots

Running a DEA Coastlines analysis using the command-line interface (CLI)

These three modules have a command-line interface that can be used to automate each stage of the analysis. An example of using these tools is provided in the following Jupyter Notebook: * DEA Coastlines generation using command line tools

For help using these command line tools, run: python -m coastlines.raster --help python -m coastlines.vector --help python -m coastlines.continental --help

Analysis outputs

Files generated by DEA Coastlines are exported to the data directory.

Temporary raster and vector outputs produced by coastlines.raster and coastlines.vector for each study area grid cell are exported to: data/interim/raster/{unique_analysis_name}/{unique_analysis_name}_{study_area_name} data/interim/vector/{unique_analysis_name}/{unique_analysis_name}_{study_area_name}

Once all study area grid cells have been processed, these are combined into a continental-scale output GeoPackage vector file and zipped ESRI Shapefiles using coastlines.continental. These final outputs are exported to: data/processed/{unique_analysis_name}/coastlines_{continental_version}.gpkg data/processed/{unique_analysis_name}/coastlines_{continental_version}.shp.zip

Data access

Data download

To download DEA Coastlines data for the entire Australian coastline, visit the "Access" tab of the Geoscience Australia DEA Coastlines product description and follow the instructions under "Access notes". Data is available in two formats:

• GeoPackage (recommended): suitable for QGIS; includes built-in symbology for easier interpretation
• ESRI Shapefiles: suitable for ArcMap and QGIS

Interactive map

To explore DEA Coastlines on an interactive map, visit the Digital Earth Australia Maps platform.

Loading DEA Coastlines data from the Web Feature Service (WFS) using Python

DEA Coastlines data can be loaded directly in a Python script or Jupyter Notebook using the DEA Coastlines Web Feature Service (WFS) and geopandas:

``` import geopandas as gpd

Specify bounding box

ymax, xmin = -33.65, 115.28 ymin, xmax = -33.66, 115.30

Set up WFS requests for annual shorelines & rates of change points

deaclannualshorelineswfs = f'https://geoserver.dea.ga.gov.au/geoserver/wfs?' \ f'service=WFS&version=1.1.0&request=GetFeature' \ f'&typeName=dea:shorelinesannual&maxFeatures=1000' \ f'&bbox={ymin},{xmin},{ymax},{xmax},' \ f'urn:ogc:def:crs:EPSG:4326' deaclratesofchangewfs = f'https://geoserver.dea.ga.gov.au/geoserver/wfs?' \ f'service=WFS&version=1.1.0&request=GetFeature' \ f'&typeName=dea:ratesof_change&maxFeatures=1000' \ f'&bbox={ymin},{xmin},{ymax},{xmax},' \ f'urn:ogc:def:crs:EPSG:4326'

Load DEA Coastlines data from WFS using geopandas

deaclannualshorelinesgdf = gpd.readfile(deaclannualshorelineswfs) deaclratesofchangegdf = gpd.readfile(deaclratesofchangewfs)

Ensure CRSs are set correctly

deaclannualshorelinesgdf.crs = 'EPSG:3577' deaclratesofchangegdf.crs = 'EPSG:3577'

Optional: Keep only rates of change points with "good" certainty

(i.e. no poor quality flags)

deaclratesofchangegdf = deaclratesofchangegdf.query("certainty == 'good'") ```

Loading DEA Coastlines data from the Web Feature Service (WFS) using R

DEA Coastlines data can be loaded directly into R using the DEA Coastlines Web Feature Service (WFS) and sf:

``` library(magrittr) library(glue) library(sf)

Specify bounding box

xmin = 115.28 xmax = 115.30 ymin = -33.66 ymax = -33.65

Read in DEA Coastlines annual shoreline data, using glue to insert our bounding

box into the string, and sf to load the spatial data from the Web Feature Service

and set the Coordinate Reference System to Australian Albers (EPSG:3577)

deaclannualshorelines = "https://geoserver.dea.ga.gov.au/geoserver/wfs?service=WFS&version=1.1.0&request=GetFeature&typeName=dea:shorelinesannual&maxFeatures=1000&bbox={ymin},{xmin},{ymax},{xmax},urn:ogc:def:crs:EPSG:4326" %>% glue::glue() %>% sf::readsf() %>% sf::stset_crs(3577)

Read in DEA Coastlines rates of change points

deaclratesofchange = "https://geoserver.dea.ga.gov.au/geoserver/wfs?service=WFS&version=1.1.0&request=GetFeature&typeName=dea:ratesofchange&maxFeatures=1000&bbox={ymin},{xmin},{ymax},{xmax},urn:ogc:def:crs:EPSG:4326" %>% glue::glue() %>% sf::readsf() %>% sf::stsetcrs(3577) ```

Jupyter Notebook

An Introduction to DEA Coastlines Jupyter notebook providing additional useful tools for loading and analysing DEA Coastlines data can be found on the DEA Notebooks repository. This notebook is available on the interactive DEA Sandbox learning and analysis environment for easy access via a web browser.

Credits

The FES2014 global tidal model was produced by NOVELTIS, LEGOS, CLS Space Oceanography Division and CNES. It is distributed by AVISO, with support from CNES (http://www.aviso.altimetry.fr/).

References

Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. Available: https://doi.org/10.1016/j.rse.2021.112734

Bishop-Taylor, R., Sagar, S., Lymburner, L., & Beaman, R. J. (2019a). Between the tides: Modelling the elevation of Australia's exposed intertidal zone at continental scale. Estuarine, Coastal and Shelf Science, 223, 115-128. Available: https://doi.org/10.1016/j.ecss.2019.03.006

Bishop-Taylor, R., Sagar, S., Lymburner, L., Alam, I., & Sixsmith, J. (2019b). Sub-pixel waterline extraction: Characterising accuracy and sensitivity to indices and spectra. Remote Sensing, 11(24), 2984. Available: https://doi.org/10.3390/rs11242984

Nanson, R., Bishop-Taylor, R., Sagar, S., Lymburner, L., (2022). Geomorphic insights into Australia's coastal change using a national dataset derived from the multi-decadal Landsat archive. Estuarine, Coastal and Shelf Science, 265, p.107712. Available: https://doi.org/10.1016/j.ecss.2021.107712