Recent Releases of dea-tools
dea-tools - 0.4.4
What's Changed
- Update dask client to correctly configure s3 access by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1383
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.4.3...0.4.4
- Jupyter Notebook
Published by robbibt 6 months ago
dea-tools - 0.4.3
What's Changed
- Fixes a major Dask performance issue when using using
create_local_dask_clusterto launch a Dask cluster, by correctly using theconfigure_s3_accessfunction https://github.com/GeoscienceAustralia/dea-notebooks/pull/1380 - Minor fixes to Knowledge Hub docs in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1375, https://github.com/GeoscienceAustralia/dea-notebooks/pull/1377
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.4.2...0.4.3
- Jupyter Notebook
Published by robbibt 6 months ago
dea-tools - 0.4.2
What's Changed
- Add missing
s3fsmosaicing dependency to DEA Tools by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1374
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.4.1...0.4.2
- Jupyter Notebook
Published by robbibt 7 months ago
dea-tools - 0.4.1
What's Changed
This release adds several new features to DEA Notebooks and the DEA Tools Python package:
- New Python tools for large-scale random sampling of
xarray.DataArraysby @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1363 - A new
dea_tools.mosaicsPython submodule with command line utilities for generating continental COGs and VRTs from tiled data by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1362 - A new forecasting/modelling notebook by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/911
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.4.0...0.4.1
- Jupyter Notebook
Published by robbibt 7 months ago
dea-tools - 0.4.0
What's Changed
This PR makes major changes to DEA Tools Python packaging, aimed at making the package easier to install by making difficult dependencies like datacube optional extras. All Python code has been formatted for consistency using ruff, and Python packaging and publication has been updated to a more modern approach using pyproject.toml and uv.
You can now install DEA Tools more easily into any environment from PyPI. By only minimal dependencies will be installed:
pip install dea-tools
To install with optional dependencies:
```
Install with datacube dependencies
pip install dea-tools[datacube]
Install with dependencies required to launch Jupyter Notebooks
pip install dea-tools[jupyter]
# Install with optional dependencies required for DEA Notebooks code examples pip install dea-tools[jupyter,dask_gateway,hdstats,notebooks]
Install with all optional dependencies (including difficult to install packages)
pip install dea-tools[all]
```
Other new features include:
- A new Wetlands Insight Tool interactive notebook for extracting times series plots of wetland dynamics over time
- A new Accessing Gridded Climate Data notebook for accessing Australian-specific climate data and global climate reanalysis data (ERA5)
- A new Generating Continental Scale Animations notebook for generating animations of the entire Australian continent
- Tide modelling notebooks and code updated to use more powerful functions from eo-tides
- Improvements and clean ups of classification tools and machine learning/ML notebooks
Breaking changes:
- Tide modelling functionality in dea_tools.coastal is now deprecated and roomed in favour of eo-tides
- dea_tools.spatial.interpolate_2d and contours_to_arrays functions now deprecated and removed
Pull requests
- markdown edits to landcover and Landsat notebooks by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1342
- New climate data notebook by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1335
- typos by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1343
- descriptions-improvements by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1344
- Update USAGE.rst by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1346
- Reuse workflow on provisioning db connection by @emmaai in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1347
- Fix issue with loading climate data over THREDDS by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1350
- Add WIT app to README.rst by @LaurenSchenk1 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1352
- Update classification tools and ML notebooks by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1351
- Use
uvfor managing Python package, simplify dependencies by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1349 - Simplify package publication using
uvby @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1353 - DEA Tools cleanup to improve user experience when datacube is not installed by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1354
- Apply Ruff code formatting and linting to entire DEA Tools by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1356
- Refactor to use
eo-tidestide modelling tools by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1357 - Merge WIT_app.py into wetlands.py in DEA Tools by @LaurenSchenk1 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1359
- Update
create_local_dask_clusterto work withoutdatacubedependency by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1360 - Final tidy up before DEA Tools 0.4.0 release by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1358
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.6...0.4.0
- Jupyter Notebook
Published by robbibt 8 months ago
dea-tools - 0.3.6
What's Changed
- Publish latest changes from
developtostableto release to DEA Sandbox/KH by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1236 - Fix bug affecting latest Sandbox image, update notebook code (#1237) by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1238
- Merge innovation day improvements to stable by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1248
- Merge develop to stable by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1252
- Merge develop into stable by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1254
- Merge develop to stable by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1259
- Add latest changes to stable by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1264
- Update stable with changes from develop by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1273
- Deprecate tide modelling tools in favour of
eo-tidesby @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1276 - small fixes in input for calculate_indices() rgb() by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1277
- Update product and band names in ML notebook
Machine_learning_with_ODC(#1276) by @jennaguffogg in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1278 - Implement comprehensive GitHub Actions integration tests using prod DEA ODC database by @omad in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1152
- WIT Notebook fix csv output by @LaurenSchenk1 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1280
- Publish changes to develop to DEA Sandbox and Knowledge Hub by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1281
- Update README.md by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1282
- Update load_ard for Sentinel-2C, add better error handling by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1283
- Loosen
pyTMDversion restriction, fix broken DEA Tools build by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1284 - Update PULLREQUESTTEMPLATE.md by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1288
- Update PULLREQUESTTEMPLATE.md by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1293
- Hide pull request template comments by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1306
- Update test suit to fix failures and improve setup by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1299
- updates to landcover notebooks and code for new Collection 3 by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1313
- Add pre-commit hook to avoid duplicates by @emmaai in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1314
- Exclude interactive notebooks from tests, only run "latest" on schedule (not PRs) by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1316
- Smaller lc animations by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1315
- changed order cells introducing descriptors by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1317
- Landcover code improvements by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1320
- Update
files_ignoreapproach to properly ignore interactive notebooks in tests (attempt to fix #1321) by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1322 - small changes for consistency by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1326
- Update DEA Notebooks to use Sentinel-2C by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1312
- WIT Interactive app by @LaurenSchenk1 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1325
- Update lc planetary nb by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1330
- fixed text by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1331
- Landcover updates - brand new notebook by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1332
- Update README.rst by @GL-S in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1333
- Adding a
verbose=parameter toload_ardby @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1338 - Documented a personal access token as a code comment (minor change) by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1339
- Continental-scale animation notebook by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1336
- Fix contiguity masking in
load_ardby applying fuse function by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1341
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.5...0.3.6
- Jupyter Notebook
Published by robbibt 10 months ago
dea-tools - 0.3.5
What's Changed
- Add support for model cropping within tide modelling functions by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1249
- Update WIT to add note about loading polygons without elevation values by @LaurenSchenk1 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1250
- Add GeoMAD to Notebooks sidebar and reorder sidebar items by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1251
- Renamed the 'publish notebooks to knowledge hub' github event for readability by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1253
- Moved GeoMAD notebook in the sidebar of KH by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1255
- Minor updates for NCI environment compatibility by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1256
- Updated all ODC Slack links to the new ODC Discord link by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1258
- Intertidal exposure by @erialC-P in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1261
- adding global SAR access through microsoft planetary compute by @abradley60 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1263
- Update USAGE.rst by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1268
- Minor compatibility change for tide modelling package by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1269
- Mitch predict_xr by @mitchest in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1270
- Update USAGE.rst by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1272
- Fix broken code on
unstableSandbox image by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1274
New Contributors
- @abradley60 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1263
- @mitchest made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1270
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.4...0.3.5
- Jupyter Notebook
Published by robbibt over 1 year ago
dea-tools - 0.3.4
What's Changed
- Add missing dependency (#1190) by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1191
- Point DEA Intertidal KH link to product page, not notebook (#1219) by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1220
- Geomedian notebook by @margaretharrison in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1148
- Temporarily modify
spatial.pytests to work aroundodc-geoGeobox comparison precision issue by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1235 - Fix bug affecting latest Sandbox image, update notebook code by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1237
- reorganize dask compute to avoid repeated load in wetland turbidity notebook by @uchchwhash in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1240
- Update change detection notebook by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1241
- Update Chlorophyll notebook by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1242
- Notebook runtime improvements by @JM-GA in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1245
- Reduced run time on ML with ODC notebook by @erialC-P in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1243
- Updating descriptions on the 'category pages' with new wording by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1246
- Speed up WIT notebook by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1244
- Update tide modelling notebook to be faster, add support for FES2022 by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1247
New Contributors
- @margaretharrison made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1148
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.3...0.3.4
- Jupyter Notebook
Published by robbibt over 1 year ago
dea-tools - 0.3.3
What's Changed
- Introduction to DEA Intertidal product notebook by @erialC-P in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1214
- Test new alert box format by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1216
- Point DEA Intertidal KH link to product page, not notebook by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1219
- add csv export to DEA WIT notebook by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1222
- Removed 'sandbox' from the DEA Explorer URLs by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1225
- Update index.rst by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1227
- Deleted the 'gen' folder used by Sphinx autosummary by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1228
- Moved the mock_imports file into the dea-notebooks repo by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1229
- Add updated
xr_regressionfunction for multi-dimensional linear regression by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1226 - Adding DEAfrica Wetland Turbidity notebook for Australian study site by @Matt-dea in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1175
- Add spatial interpolation with
xr_interpolatenotebook by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1233 - Updates to product notebook Knowledge Hub links and DEA notebook content by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1221
- Add ensemble tide modelling functionality to
model_tidesby @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1231
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.2...0.3.3
- Jupyter Notebook
Published by robbibt over 1 year ago
dea-tools - 0.3.2
What's Changed
- Add missing dependency by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1190
- Adding PyPi link to DEA Tools introduction and rewording intro by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1192
- Edited the repo's README by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1193
- Changed one link by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1196
- Fixing broken images on Knowledge Hub Noteboks Readme by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1197
- Update USAGE.rst, Adding Citation (Issue #1178) by @ncimino1 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1181
- Update all Knowledge Hub 'docs' links to new 'knowledge' links by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1201
- Renamed all 'Github' to 'GitHub' by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1203
- Sphinx autosummary minor update by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1202
- Add updated xr_interpolate func and tests by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1205
- Updated references to the old repo name 'dea-docs' to the new name by @benji-glitsos-ga in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1204
- Updates to DEA Waterbodies notebooks and tools for v3.0 by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1199
- DEA Waterbodies notebook for v3, closes issue #1200 by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1207
- add citation to usage.rst by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1208
- Change
xr_interpolateextent Error to Warning by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1210 - Update R^2 method in
eval_metricsby @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1211
New Contributors
- @ncimino1 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1181
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.1...0.3.2
- Jupyter Notebook
Published by robbibt almost 2 years ago
dea-tools - 0.3.1
What's Changed
A minor update to dea-tools including updates to tide modelling and parallel processing functions.
New feature: load_reproject function for loading external COG GeoTIFFs and reprojecting them to match a specific resolution or GeoBox.
- Pull pixel_tide resampling into function for easier re-use by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1149
- Update
pixel_tidesto work on non-Dask inputs by @erialC-P in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1155 - Add threads flag to parallel apply by @alexgleith in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1171
- Update several notebooks to use cleaner
odc-geocode, including newload_reprojectfunction by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1186
New Contributors
- @matt-fry-ga made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1154
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.3.0...0.3.1
- Jupyter Notebook
Published by robbibt about 2 years ago
dea-tools - 0.3.0
What's changed
Overall updates
- Major update to repository directory structure (new
Interactive_appsdirectory,Frequently_used_coderenamed toHow_to_guides,DEA_datasetsrenamed toDEA_products) - All repository content updated to the latest DEA Collection 3 Landsat and Sentinel-2 data
- Added extensive testing throughout repo (of both
dea_toolsand notebook content)
New Python package updates
- New
xr_pansharpenfunction supporting multiple options for pansharping Landsat imagery, including Brovey, ESRI, simple mean, PCA and HSV pansharpening (#994) - Major refactor of tide modelling functions (
model_tides,pixel_tides) to add support for multiple tide models and parallel processing (#1077, #1112, #1142, #1084) - New function to calculate points on a line (#1014)
- Updated
load_ardto support Sentinel-2 data and thes2cloudlesscloud mask (#984, #1000) - Update
subpixel_contoursto allow custom time formats (#1065) - Updated
dea_tools.spatialfunctions to use spatial tools fromodc-geo(#978, #1039) - New function to calculate points on a line (#1014)
- New helper functions
folium_mapandipyleaflet_mapthat enables easy placing of anxarray.Dataseton a webmap (#1145) - New
folium_dual_mapfunction to allow easily comparing datasets side-by-side (#1145)
New Jupyter notebooks and features
- New introductory Wetlands Insight Tool notebook (#1102)
- New introductory DEA Mangroves notebook (#1131)
- New introductory DEA Surface Reflectance (Sentinel-2, Collection 3) notebook
- New Sunglint masking with Sentinel-2 notebook (#1122)
- New Pansharpening Landsat with
xr_pansharpennotebook (#994) - New Combining data from DEA and Microsoft Planetary Computer notebook (#1097)
- New Visualising coastal turbidity notebook (#1073)
- New Determining seasonal extent of waterbodies with Sentinel-2 notebook (#1054)
- New Monitoring water quality notebook (#1146)
- New Near real-time burnt area mapping using DEA notebook (#1049)
- Added a search bar and marker to interactive widgets (#1096)
- Updated DEA Landsat Surface Reflectance notebook to include an example of cloud buffering with
load_ard(#1094) - Updated Generating satellite imagery animations notebook to add a combined Sentinel-2 and Landsat option (#1043)
- Extracted coastal transect app from DEA Coastlines notebook and moved it to a new
Interactive_appsnotebook (#1032)
Examples
New Contributors
- @geoscience-aman made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/956
- @andressutton made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/991
- @LaurenSchenk1 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1025
- @treefern made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1026
- @mdasi00 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1029
- @Joram95 made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1073
- @Ariana-B made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/1081
PyPI
https://pypi.org/project/dea-tools/0.3.0/
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.7...0.3.0
- Jupyter Notebook
Published by robbibt over 2 years ago
dea-tools - Release 0.2.8
What's Changed
- major update to the
load_ardfunction to allow the function to support the new Sentinel-2 Collection 3 products https://github.com/GeoscienceAustralia/dea-notebooks/pull/984 wetlands.pywetlands module added to run DEA Wetlands Insight Tool notebook https://github.com/GeoscienceAustralia/dea-notebooks/pull/1102- Update and simplify
xr_rasterize,xr_vectoriseandsubpixel_contoursby usingodc-geohttps://github.com/GeoscienceAustralia/dea-notebooks/pull/978 - Add missing dependencies to
setup.py, remove no longer usedsegmentation.pyhttps://github.com/GeoscienceAustralia/dea-notebooks/pull/1003
PyPI
https://pypi.org/project/dea-tools/0.2.8/
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.7...0.2.8
- Jupyter Notebook
Published by uchchwhash over 2 years ago
dea-tools - 0.2.7
What's Changed
- Fix missing function import in
pixel_tidesby @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/940
PyPI
https://pypi.org/project/dea-tools/0.2.7/
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.6...0.2.7
- Jupyter Notebook
Published by robbibt over 3 years ago
dea-tools - 0.2.6
New features
Real_world_examples/Generating_satellite_animations.ipynb
- An interactive "app" notebook for exporting time series satellite imagery animations by drawing a box on a map and selecting a custom time period.
https://user-images.githubusercontent.com/17680388/183581425-bd015371-8ec6-49d0-a035-1f64f98c7da2.mp4
dea_tools.coastal
dea_tools.coastal.model_tides: A replacement for the existingtidal_tagfunc that uses the open-source FES2014 tidal model.dea_tools.coastal.pixel_tides: A more advanced tidal model function that models tides across the 2D extent of a satellite imagery dataset, then interpolates that data into each pixel of the dataset. Used in DEA Coastlines to create seamless tidal composites and shorelines (with no discontinuities along study area boundaries).
dea_tools.datahandling
dea_tools.datahandling.parallel_apply: A function for applying a custom function in parallel along a specific dimension in anxarray(e.g. for each timestep), using multiprocessing from theconcurrent.futurespackage
dea_tools.spatial
dea_tools.spatial.hillshade: A function for generating hillshades on DEM data, using custom sun angles and azimuths.dea_tools.spatial.sun_angles: A function for extracting average sun angles and azimuths from DEA Collection 3 metadata for each timestep in a satellite dataset. Can be used to identify pixels that are likely to be affected by terrain shadow in surface reflectance data.
What's Changed (full changelog)
- Fix failed Dask worker pod launch due to invalid username characters by @jmettes in https://github.com/GeoscienceAustralia/dea-notebooks/pull/928
- New generating animations interactive notebook by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/927
- Waterbodies fix by @vnewey in https://github.com/GeoscienceAustralia/dea-notebooks/pull/932
- Move datacube import lower in STAC notebook to reduce confusion by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/933
- remove unused import of write_geotiff by @ErinKenna in https://github.com/GeoscienceAustralia/dea-notebooks/pull/930
- Add missing rasterstats and geopy dependency by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/934
- Add funcs from DEA Coastlines and DEA Intertidal to DEA Tools by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/936
- fix to Surface Area Duration NB by @vnewey in https://github.com/GeoscienceAustralia/dea-notebooks/pull/937
New Contributors
- @jmettes made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/928
- @vnewey made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/932
- @ErinKenna made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/930
PyPI
https://pypi.org/project/dea-tools/
- Jupyter Notebook
Published by robbibt over 3 years ago
dea-tools - 0.2.5
What's Changed
- Add ability to plot a colour bar on level 4 animation by @Kooie-cate in https://github.com/GeoscienceAustralia/dea-notebooks/pull/915
- Update notebooks to use C3 derivatives by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/917
- Optimise test github action by @pindge in https://github.com/GeoscienceAustralia/dea-notebooks/pull/920
- Unpin index image for docker-compose by @pindge in https://github.com/GeoscienceAustralia/dea-notebooks/pull/921
- Remove ignore from basic analysis notebook tests by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/922
- Support for FES2014 tide model via CNES aviso-fes. by @rtaib in https://github.com/GeoscienceAustralia/dea-notebooks/pull/919
- Pin pip to allow build Action to work by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/924
New Contributors
- @pindge made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/920
- @rtaib made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/919
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.4...0.2.5
- Jupyter Notebook
Published by robbibt over 3 years ago
dea-tools - 0.2.4
What's Changed
Updates to ML notebooks/scripts, load_ard, and phenology
- Update Polygon_drill.ipynb by @CEKrause in https://github.com/GeoscienceAustralia/dea-notebooks/pull/897
- DEA Land Cover notebook suite by @bellemae in https://github.com/GeoscienceAustralia/dea-notebooks/pull/898
- Update animation notebook to use MP4s by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/903
- Add Fractional Cover reprocessing notebook and results by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/905
- Add DEA training to repo by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/906
- Update README.rst by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/907
- Ah, add my conf paper by @BexDunn in https://github.com/GeoscienceAustralia/dea-notebooks/pull/908
- Remove spatial cross validation from Scalable ML by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/909
- Update phenology notebook and script by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/910
- Add morphological filtering to
load_ardby @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/912 - Conference contribution GeoPython by @sebfoe in https://github.com/GeoscienceAustralia/dea-notebooks/pull/914
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.3...0.2.4
- Jupyter Notebook
Published by cbur24 almost 4 years ago
dea-tools - 0.2.3
What's Changed
- Updated image export notebook to an interactive app that requires no coding by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/894
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.2...0.2.3
- Jupyter Notebook
Published by robbibt about 4 years ago
dea-tools - 0.2.2
What's Changed
- Add new func for plotting fmask data with automatic colours by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/886
- Update to document new Coastlines paper and use recently added Dask and Geopandas functionality by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/887
- Updated courses and training by @Bethany-M in https://github.com/GeoscienceAustralia/dea-notebooks/pull/889
- Add coastlines paper to repo usage by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/890
- Add new interactive DEA Coastlines app and move all widgets to
dea_tools.appsubmodule by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/892
New Contributors
- @Bethany-M made their first contribution in https://github.com/GeoscienceAustralia/dea-notebooks/pull/889
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.1...0.2.2
- Jupyter Notebook
Published by robbibt about 4 years ago
dea-tools - 0.2.1
What's Changed
- Notebook for exporting high quality satellite images from an interactive map by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/870
- Add new functionality to Image export notebook and functions by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/873
- Fix image export for Sentinel-2 NRT by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/876
- Add first set of basic Testbook tests to DEA Notebooks by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/872
- Add option for returning dask client by @cbur24 in https://github.com/GeoscienceAustralia/dea-notebooks/pull/882
- Remove in-text references to Scripts by @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/883
- Fix broken
tidal_tagfunction indea_tools.coastalby @robbibt in https://github.com/GeoscienceAustralia/dea-notebooks/pull/884
Full Changelog: https://github.com/GeoscienceAustralia/dea-notebooks/compare/0.2.0...0.2.1
- Jupyter Notebook
Published by robbibt over 4 years ago
dea-tools - 0.2.0
Changes
- Updated all notebooks for compatibility with the recently updated Python 3.8 DEA Sandbox environment.
- Updated the DEA Notebooks repository to remove the
Scriptsdirectory, and load functions from thedea-toolsPython module instead (located in theToolsdirectory of the repository). If you previously imported functions fromScriptsusing the following syntax:import sys sys.path.insert(1, '../Scripts') from dea_datahandling import load_ard
Please replace this with:
import sys
sys.path.insert(1, '../Tools')
from dea_tools.datahandling import load_ard
Alternatively, dea-tools can now be installed directly from PyPI using:
pip install dea-tools
from dea_tools.datahandling import load_ard
Note: If you previously accessed the DEA Sandbox environment, the
Scriptsfolder will not be removed automatically. We recommend deleting it yourself by opening a terminal, then typingrm -r Scripts:

- Jupyter Notebook
Published by robbibt over 4 years ago
dea-tools - Pre dea-tools archive
1 December 2020 update: To make it easier to import DEA functions on the NCI, Sandbox as well as external repositories or platforms like DEAfrica, we are planning to build the modules and functions currently located in /Scripts into a pip-installable Python package (https://github.com/GeoscienceAustralia/dea-notebooks/issues/538, https://github.com/GeoscienceAustralia/dea-notebooks/pull/705). This release tags the last version of the develop branch prior to merging in these changes.
- Jupyter Notebook
Published by robbibt about 5 years ago
dea-tools - DEA-notebooks refresh
9 January 2020 update: This repository was recently upgraded to a new directory structure and set of improved and easier to use Jupyter notebooks and scripts. To access an archive of the previous version of the repository, visit the master_archive branch. Please note that notebooks and code in the master_archive branch are no longer maintained or supported.
- Jupyter Notebook
Published by robbibt about 6 years ago
dea-tools - Pre-refresh archive
On January 9th, dea-notebooks was upgraded to a new directory structure and a new and improved set of Jupyter notebooks and scripts. This release preserves the history of the repository prior to this change. Please note that notebooks and code in this release (and earlier) are no longer maintained or supported.
Also archived in the master_archive branch: https://github.com/GeoscienceAustralia/dea-notebooks/tree/master_archive
- Jupyter Notebook
Published by robbibt about 6 years ago