Recent Releases of Solar Data Tools

Solar Data Tools - v2.0.1

What's Changed

  • Prune non-critical source code from sdist by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/210

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v2.0.0...v2.0.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou 7 months ago

Solar Data Tools - v2.0.0

Major change: Complete removal of old Statistical Clear Sky Fitting module

  • This release removes the SCSF module from SDT: https://github.com/slacgismo/solar-data-tools/tree/2ae5f974ee7da4f4d6a6c064f0d908e291b57c27/statisticalclearsky
  • Clear sky model fitting is carried out with a new method called smooth, periodic quantile fitting
  • Long-term degradation estimation is carried out with the updated loss factor analysis
  • These new methods superseded the old SCSF method based on low-rank modeling
  • Updated methods are described in our User Guide

What's Changed

  • PyOS review updates and fixes (part 1) by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/197
  • Update precommit hooks and add ruff linting (PyOS review part 2) by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/198
  • Add pyOS badge to README by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/204
  • add kwargs to shade algo run by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/182
  • Add joss badge by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/207
  • clear sky detection module by @giray98 in https://github.com/slacgismo/solar-data-tools/pull/165
  • Remove Statistical Clear Sky Fitting module by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/206
  • Removing support for all data io functions by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/208

New Contributors

  • @giray98 made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/165

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.7.1...v2.0.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers 8 months ago

Solar Data Tools - v1.7.1 Dask batch processing update

What's Changed

  • Quick fix to Dask local csv data plug by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/196

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.7.0...v1.7.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers 10 months ago

Solar Data Tools - v1.7.0 Capacity change detection improvements

What's Changed

  • Capacity change algorithm rewrite, closes #192 by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/193
  • Better optimized code tested on a wide variety of example data sets with both CLARABEL and MOSEK solvers
  • Improved weight selection algorithm removes randomness of holdout validation

image image image

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.6.6...v1.7.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers 11 months ago

Solar Data Tools - v1.6.6

What's Changed

  • Fixing a bug in dilation.py by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/181

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.6.5...v1.6.6

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers about 1 year ago

Solar Data Tools - v1.6.5

What's Changed

  • fix typo in docs index page by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/179
  • development of dilation module by @AramisDuf in https://github.com/slacgismo/solar-data-tools/pull/180

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.6.4...v1.6.5

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers about 1 year ago

Solar Data Tools - v1.6.4

What's Changed

  • Deploy docker by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/172
  • Update conda install documentation by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/178

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.6.3...v1.6.4

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou over 1 year ago

Solar Data Tools - v1.6.3

What's Changed

  • Conda build fix by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/175
  • Patch to fix pandas warnings about depricated behavior. by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/174
  • Prep for conda-forge migration by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/176
  • rm conda build from release by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/177

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.6.2...v1.6.3

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou over 1 year ago

Solar Data Tools - v1.6.2

What's Changed

  • Dev - fixes RTD deployment by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/166

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.6.1...v1.6.2

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou over 1 year ago

Solar Data Tools - v1.6.1

What's Changed

Revamped documentation pages!

  • Merging main by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/112
  • Merge new main into docs branch by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/141
  • Merge docs by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/159
  • Update issue/PR templates by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/163
  • Revamped Docs by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/164

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.6.0...v1.6.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou over 1 year ago

Solar Data Tools - v1.6.0

What's Changed

  • Releasing our new Solar Data Tools Dask tool developed by our Spring 2024 CMU students:
    • @nimishy
    • @zhanghaoc
    • @vlianCMU
  • Merge new Dask SDT runner tool by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/157
  • Temp conda recipe fix by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/162

New Contributors

  • @zhanghaoc made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/131
  • @nimishy made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/154

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.5.0...v1.6.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou over 1 year ago

Solar Data Tools - v1.5.0

What's Changed

  • Updates to change detection algorithms to improve accuracy and stability by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/161
  • These algorithms are used in the time-shift detection and capacity change detection subroutines
  • Other small quality-of-life improvements, including a catch for very short data sets that previously threw an unintelligible error

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.4.0...v1.5.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers over 1 year ago

Solar Data Tools - v1.4.0

What's Changed

  • New definitions for many SD problem forumations, with improved performance by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/158
  • clear depr and future warnings by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/152

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.3.2...v1.4.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers over 1 year ago

Solar Data Tools - v1.3.2

What's Changed

  • Update README.md by @KPCOFGS in https://github.com/slacgismo/solar-data-tools/pull/148
  • Update README.md to clarify and fix conda install issues by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/149

New Contributors

  • @KPCOFGS made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/148

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.3.1...v1.3.2

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou almost 2 years ago

Solar Data Tools - v1.3.1

What's Changed

  • adjust MANIFEST.in for tar and toml for wheel by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/146

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.3.0...v1.3.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou almost 2 years ago

Solar Data Tools - v1.3.0

What's Changed

  • Update package by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/140
    • move to pyproject.toml
    • clean up dependencies
    • make mosek optional in test workflow
    • update ci/cd, builds and conda recipe
  • Update README.md by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/145

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.2.2...v1.3.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou almost 2 years ago

Solar Data Tools - v1.2.2

What's Changed

  • Time shift by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/134

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.2.1...v1.2.2

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou almost 2 years ago

Solar Data Tools - v1.2.1

What's Changed

  • pass solver correctly to _cvx SD functions by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/133

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.2.0...v1.2.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou almost 2 years ago

Solar Data Tools - New "time shift" algorithm behavior, and other updates

What's Changed

  • Changes to the "time shift detection" algorithm by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/128. Default behavior is now to implement time shift corrections, rounded to the nearest hour. Previously, the algorithm rounded to the nearest index point (e.g., 5-minute interval for 5-minute data). In addition, this fixes a bug in the time shift detection algorithm that caused the pipeline to fail on some data sets. The actually implemented corrections are now saved in TimeShift.correction_estimate in units of minutes.
  • "Time dilation" function by @AramisDuf in https://github.com/slacgismo/solar-data-tools/pull/121. The function makes use of sunrise/sunset times estimated by the data handler to transform measured data to remove the nighttime and resample the resulting vectors to all have the same length (while respecting interval integrated energy).

New Contributors

  • @AramisDuf made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/121

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.1.1...v1.2.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers almost 2 years ago

Solar Data Tools - v1.1.1

What's Changed

  • Update conda version and spcqe install by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/127

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.1.0...v1.1.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou almost 2 years ago

Solar Data Tools - v1.1.0

Highlights

  • New feature: updated degradation estimation (with uncertainty) plus full loss factor analysis
  • New PVDB Redshift Cluster dataio import function
  • User experience improvements
  • Bug fixes in capacity change analysis and pv system profiler

What's Changed

  • Add data import function for redshift data by @MitchellAV in https://github.com/slacgismo/solar-data-tools/pull/111
  • Finalization of loadredshiftdata function and AWS architecture by @MitchellAV in https://github.com/slacgismo/solar-data-tools/pull/119
  • PVDB Redshift Cluster data import function by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/118
  • Loss factor analysis by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/122
  • User experience improvements by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/124
  • New Feature: Updated degradation estimation (with uncertainty) plus full loss factor analysis by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/123
  • Small fixes and adjustments by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/125
  • Minor user experience improvements by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/126

New Contributors

  • @MitchellAV made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/111

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.0.5...v1.1.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by pluflou almost 2 years ago

Solar Data Tools - v1.0.5

What's Changed

Bug fix in daily energy calculation!

  • Docs update by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/102
  • Merging main into dev by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/110
  • new utilities for time dilation by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/107

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.0.4...v1.0.5

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers about 2 years ago

Solar Data Tools - v1.0.4

Fixed typo for anaconda login....

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.0.3...v1.0.4

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by Thistleman over 2 years ago

Solar Data Tools - v1.0.3

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.0.2...v1.0.3

Fixed step typo in github actions for final upload.

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by Thistleman over 2 years ago

Solar Data Tools - v1.0.2

What's Changed

  • Update meta.yaml by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/109
  • Clarabel install added to conda recipe
  • Returned to using conda post-adoption of libmamba solver and to fix broken mamba build

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.0.1...v1.0.2

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by Thistleman over 2 years ago

Solar Data Tools - Fixed pypi publishing

  • Fixed pypi publishing due to deprecation of twine uploads, in favor of the more secure trusted publishing.

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v1.0.0...v1.0.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by Thistleman over 2 years ago

Solar Data Tools - SDT version 1!

This is it, folks, the one we've all been waiting for! The main pipeline now runs (quickly!) without the need for the MOSEK commercial solver. We don't yet have full coverage for all the other algorithms in SDT (such as soiling and clear sky analysis), but system profiling (tilt, azimuth, lat, and lon estimation) is supported!

What's Changed

  • SDT with OSD support by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/98
  • PR from Sara: Ready for v1! by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/99
  • PR to cover updates for V1.0.0 of SDT by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/97
  • moving to mamba build by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/100
  • New development work by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/104

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v0.8.0...v1.0.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers over 2 years ago

Solar Data Tools - v0.8.0

Highlights

  • Improvements to the tilt and azimuth estimation algorithm
  • Signal decomposition problems now in alignment with published theory https://web.stanford.edu/~boyd/papers/sigdecompmprox.html
  • Lots of PEP8 aesthetic changes

What's Changed

  • Qss sara by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/95
  • Qss sara by @pluflou in https://github.com/slacgismo/solar-data-tools/pull/96
  • New features for main branch and eventual release by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/91

New Contributors

  • @pluflou made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/95

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v0.7.1...v0.8.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers almost 3 years ago

Solar Data Tools - v0.7.1

What's Changed

  • Processor branch by @claireberschauer in https://github.com/slacgismo/solar-data-tools/pull/87
  • better reporting by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/89
  • Added requirements to conda recipe, added mosek channel to conda build by @Thistleman in https://github.com/slacgismo/solar-data-tools/pull/86
  • remove infinite while loop! by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/93

New Contributors

  • @claireberschauer made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/87

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v0.7.0...v0.7.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers almost 3 years ago

Solar Data Tools - v0.7.0

What's Changed

  • Integration of Statistical Clear Sky Fitting and PV System Profiler projects into SDT codebase
  • Updated example notebooks

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v0.6.1...v0.7.0

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers over 3 years ago

Solar Data Tools - Hotfix: deployment issues

What's Changed

  • setup.py updates by @bmeyers in https://github.com/slacgismo/solar-data-tools/pull/83
  • Hotfix/pvlib by @Thistleman in https://github.com/slacgismo/solar-data-tools/pull/84

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v0.6.0...v0.6.1

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers over 3 years ago

Solar Data Tools - New Algorithms!

New algorithm modules added for shade loss estimation and soiling loss estimation. Also, new tests and improved CI/CD.

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers over 3 years ago

Solar Data Tools - Migrated CI/CD from CircleCI to Github Actions

What's Changed

  • Pre commit fix by @derins in https://github.com/slacgismo/solar-data-tools/pull/74
  • Migrate CircleCI to Github Actions by @Thistleman in https://github.com/slacgismo/solar-data-tools/pull/77
  • update badge in README.md by @Thistleman in https://github.com/slacgismo/solar-data-tools/pull/78

New Contributors

  • @Thistleman made their first contribution in https://github.com/slacgismo/solar-data-tools/pull/77

Full Changelog: https://github.com/slacgismo/solar-data-tools/compare/v0.5.4...v0.5.5

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by Thistleman almost 4 years ago

Solar Data Tools - Bug fixes

  • Improved NaN handling in the clear day detection algorithm
  • Use of sklearn to do train/test splitting in time shift analysis for setting OSD parameter
  • Better plotting function in time shift analysis module

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by bmeyers over 4 years ago

Solar Data Tools - Added dependencies for statistical-clear-sky and pv-system-profiler

  • Added dependency to pvi-user.yml, meta.yaml and requirements.txt

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by derins over 4 years ago

Solar Data Tools - Conda Bug Fix

  • Conda build issue fix

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by derins over 4 years ago

Solar Data Tools - Added dependencies

Bug fixes - Added missing dependency pvlib in to pip and conda packages

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by derins over 4 years ago

Solar Data Tools -

Generating DOI Tag

Scientific Software - Peer-reviewed - Jupyter Notebook
Published by derins over 4 years ago