WV View Deep Learning Examples

Overview

The goal of this repository is to provide example workflows for geospatial deep learning. The primary focus is semantic segmentation for pixel-based classification. However, we will also provide examples demonstrating object detection/instance segmentation and scene classification. We plan to continue to add examples and make updates. This material is associated with the WV View Geospatial Deep Learning seminar.

WV View is supported by AmericaView and the U.S. Geological Survey under Grant/Cooperative Agreement No. G18AP00077.

The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the opinions or policies of the U.S. Geological Survey. Mention of trade names or commercial products does not constitute their endorsement by the U.S. Geological Survey.

Folders

1. PyTorch_SAT6: Use PyTorch/Python and R to classify aerial image scenes using CNNs. Example data are DeepSat SAT-6 Dataset.
2. PyTorchUNettopoDL: Use PyTorch/Python and R to extract historic surface mine extents from topographic maps using UNet semantic segmentation. Example dataset is topoDL Dataset.
3. PyTorchDeepLabInria: Use PyTorch/Python and R to extract building footprints using DeepLabv3+ semantic segmentation. Example data are Inria Aerial Image Labeling Dataset.
4. PyTorchUNetPPLandcoverai: Use PyTorch/Python and R to map general land cover using UNet++ semantic segmentation. Example dataset is LandCover.ai.
5. PyTorchUNetPPwvlcDL: Use PyTorch/Python and R to map general land cover with incomplete training data using UNett++ semantic segmentation. Example data are wvlcDL_5m Dataset.

Videos

The following videos step through example using ArcGIS Pro without any coding, our PyTorch/Python and R examples, and settting up deep learning environments.

1. Set Up ArcGIS Pro for Deep Learning
2. UNet Semantic Segmentation with ArcGIS Pro (topoDL)
3. Object Detect/Instance Segmentation with ArcGIS Pro (vfillDL)
4. Set up PyTorch Python environment using Anaconda
5. PyTorch/R CNN Scene Classification (DeepSat SAT-6 Dataset)
6. PyTorch/R Semantic Segmentation (topoDL)
7. Pytorch/R Sematnic Segmentation (Inria)
8. PyTorch/R Semantic Segmentation (LandCover.ai)
9. PyTorch/R Semantic Segmentation (wvlcDL_5m)

Data

The datasets used in the examples are linked below.

1. topoDL
2. vfillDL
3. wvlcDL_5m
4. SAT-6
5. Inria
6. LandCover.ai

Papers

The listed papers explain the datasets used in our examples.

1. Maggiori, E., Tarabalka, Y., Charpiat, G. and Alliez, P., 2017, July. Can semantic labeling methods generalize to any city? the inria aerial image labeling benchmark. In 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS) (pp. 3226-3229). IEEE.
2. Boguszewski, A., Batorski, D., Ziemba-Jankowska, N., Zambrzycka, A. and Dziedzic, T., 2020. LandCover. ai: Dataset for Automatic Mapping of Buildings, Woodlands and Water from Aerial Imagery. arXiv preprint arXiv:2005.02264.
3. Basu, S., Ganguly, S., Mukhopadhyay, S., DiBiano, R., Karki, M. and Nemani, R., 2015, November. Deepsat: a learning framework for satellite imagery. In Proceedings of the 23rd SIGSPATIAL international conference on advances in geographic information systems (pp. 1-10).
4. Maxwell, A.E., Bester, M.S., Guillen, L.A., Ramezan, C.A., Carpinello, D.J., Fan, Y., Hartley, F.M., Maynard, S.M. and Pyron, J.L., 2020. Semantic Segmentation Deep Learning for Extracting Surface Mine Extents from Historic Topographic Maps. Remote Sensing, 12(24), p.4145.
5. Maxwell, A.E., Pourmohammadi, P. and Poyner, J.D., 2020. Mapping the topographic features of mining-related valley fills using mask R-CNN deep learning and digital elevation data. Remote Sensing, 12(3), p.547.
6. Maxwell, A.E., Strager, M.P., Warner, T.A., Ramezan, C.A., Morgan, A.N. and Pauley, C.E., 2019. Large-Area, High Spatial Resolution Land Cover Mapping Using Random Forests, GEOBIA, and NAIP Orthophotography: Findings and Recommendations. Remote Sensing, 11(12), p.1409.

Links

Links to software tools and packages.

Deep Learning Python

• PyTorch
• arcgis.learn module
• Segmentation Models PyTorch
• Albumentations
• opencv-python

Geospatial Data in Python

• Rasterio
• GeoPandas

Python Data Science

• NumPy
• Pandas
• Matplotlib
• Seaborn
• SciPy
• Scikit-learn

R General Data Science

• tidyverse
• dplyr
• ggplot2
• caret
• tidymodels
• yardstick
• rfUtilities
• diffeR
• pROC
• torch
• imager
• randomForest
• e1071

R Geospatial Data Science

• sp
• rgdal
• sf
• star
• raster
• terra
• leaflet
• tmap
• tmaptools
• lidR