Recent Releases of dplutils

dplutils - v0.8.1

What's Changed

  • Bump the all-minor-and-patch-dependency-updates group with 6 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/121
  • Bump the all-minor-and-patch-dependency-updates group with 5 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/122
  • Bump the all-minor-and-patch-dependency-updates group with 5 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/123
  • Bump the all-minor-and-patch-dependency-updates group with 6 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/126
  • resource request scheduling fix for 0 case by @amitschang in https://github.com/ssec-jhu/dplutils/pull/125

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.8.0...v0.8.1

- Python
Published by amitschang 12 months ago

dplutils - v0.8.0

What's Changed

  • Bump the all-minor-and-patch-dependency-updates group with 7 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/112
  • Bump pytest-cov from 5.0.0 to 6.0.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/113
  • Bump build from 1.2.2 to 1.2.2.post1 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/116
  • Bump sphinx-issues from 4.1.0 to 5.0.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/115
  • upgrade pyarrow to 17 by @amitschang in https://github.com/ssec-jhu/dplutils/pull/118
  • add some infrastructure logging for executors by @amitschang in https://github.com/ssec-jhu/dplutils/pull/119
  • fixing walk order to resolve priority in multi-sink pipelines by @amitschang in https://github.com/ssec-jhu/dplutils/pull/120

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.7.2...v0.8.0

- Python
Published by amitschang over 1 year ago

dplutils - v0.7.2

What's Changed

  • fixing upload artifact version by @amitschang in https://github.com/ssec-jhu/dplutils/pull/111

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.7.1...v0.7.2

- Python
Published by amitschang over 1 year ago

dplutils - v0.7.1

What's Changed

  • Bump the all-minor-and-patch-dependency-updates group with 8 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/110

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.7.0...v0.7.1

- Python
Published by amitschang over 1 year ago

dplutils - v0.7.0

What's Changed

  • Bump the all-minor-and-patch-dependency-updates group with 6 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/102
  • Bump sphinx from 7.3.7 to 8.0.2 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/103
  • Add pipeline-specific help info by @amitschang in https://github.com/ssec-jhu/dplutils/pull/106
  • Bump the all-minor-and-patch-dependency-updates group with 6 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/108
  • Bump actions/download-artifact from 3 to 4.1.7 in /.github/workflows by @dependabot in https://github.com/ssec-jhu/dplutils/pull/109

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.6.0...v0.7.0

- Python
Published by amitschang over 1 year ago

dplutils - v0.6.0

What's Changed

  • Bump the all-minor-and-patch-dependency-updates group with 7 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/93
  • Improve support for pipeline config from file by @amitschang in https://github.com/ssec-jhu/dplutils/pull/96
  • Fix bug in task validation to handle variadic args by @amitschang in https://github.com/ssec-jhu/dplutils/pull/98
  • Fix streaming input for batch and multiple sources by @amitschang in https://github.com/ssec-jhu/dplutils/pull/99

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.5.5...v0.6.0

- Python
Published by amitschang over 1 year ago

dplutils - v0.5.5

What's Changed

  • fixing pandas dep, replace with ray dep restriction by @amitschang in https://github.com/ssec-jhu/dplutils/pull/92

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.5.4...v0.5.5

- Python
Published by amitschang over 1 year ago

dplutils - v0.5.4

What's Changed

  • Bump the all-minor-and-patch-dependency-updates group with 5 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/88
  • Add formatter by @ryanhausen in https://github.com/ssec-jhu/dplutils/pull/89
  • Fix dataframe splitting numpy issue by @amitschang in https://github.com/ssec-jhu/dplutils/pull/91
  • Skip zero-length batches in stream executor by @amitschang in https://github.com/ssec-jhu/dplutils/pull/90

New Contributors

  • @ryanhausen made their first contribution in https://github.com/ssec-jhu/dplutils/pull/89

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.5.3...v0.5.4

- Python
Published by amitschang over 1 year ago

dplutils - v0.5.3

Primarily a docs release

What's Changed

  • Add usage docs by @amitschang in https://github.com/ssec-jhu/dplutils/pull/81
  • Group dependabot PRs by @jamienoss in https://github.com/ssec-jhu/dplutils/pull/82
  • Bump pytest-cov from 4.1.0 to 5.0.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/84
  • Bump the all-minor-and-patch-dependency-updates group with 13 updates by @dependabot in https://github.com/ssec-jhu/dplutils/pull/83
  • Add more usage docs by @amitschang in https://github.com/ssec-jhu/dplutils/pull/86

New Contributors

  • @jamienoss made their first contribution in https://github.com/ssec-jhu/dplutils/pull/82

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.5.2...v0.5.3

- Python
Published by amitschang almost 2 years ago

dplutils - v0.5.2

What's Changed

  • Fix bug in passing multiple set config per task via cli by @amitschang in https://github.com/ssec-jhu/dplutils/pull/78

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.5.1...v0.5.2

- Python
Published by amitschang almost 2 years ago

dplutils - v0.5.1

What's Changed

  • Fix bug in source generation for input batch size > 1 by @amitschang in https://github.com/ssec-jhu/dplutils/pull/75

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.5.0...v0.5.1

- Python
Published by amitschang almost 2 years ago

dplutils - v0.5.0

What's Changed

  • Tag outputs with task from which they came by @amitschang in https://github.com/ssec-jhu/dplutils/pull/66
  • Bump pyarrow from 15.0.0 to 15.0.2 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/73
  • Bump tox from 4.12.1 to 4.14.2 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/71
  • Move remote setup in ray stream executor to enable configuration by @amitschang in https://github.com/ssec-jhu/dplutils/pull/68
  • Bump pytest from 8.0.2 to 8.1.1 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/70
  • Bump mlflow from 2.10.0 to 2.11.3 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/72
  • Bump ray[default] from 2.9.3 to 2.10.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/69

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.4.0...v0.5.0

- Python
Published by amitschang almost 2 years ago

dplutils - v0.4.0

What's Changed

  • update dependencies by @amitschang in https://github.com/ssec-jhu/dplutils/pull/58
  • Make generator configurable for stream executor by @amitschang in https://github.com/ssec-jhu/dplutils/pull/59

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.3.1...v0.4.0

- Python
Published by amitschang almost 2 years ago

dplutils - v0.3.1

This release mainly sets limit on pandas version due to issue in ray (https://github.com/ray-project/ray/issues/42842)

What's Changed

  • Bump mlflow from 2.9.2 to 2.10.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/48
  • Bump ruff from 0.1.10 to 0.1.15 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/49
  • Bump tox from 4.11.4 to 4.12.1 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/46
  • Bump bandit from 1.7.5 to 1.7.7 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/45
  • small doc edits and pypi badge by @amitschang in https://github.com/ssec-jhu/dplutils/pull/50
  • limit pandas version by @amitschang in https://github.com/ssec-jhu/dplutils/pull/52

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.3.0...v0.3.1

- Python
Published by amitschang about 2 years ago

dplutils - dplutils-v0.3.0

Highlights

This release adds a new executor framework and ray implementation capable of streaming graphs with branching, multiple inputs/outputs, and true indefinite source generation, overcoming some limitations of the ray data pipelines based executor. See StreamingGraphExecutor and RayStreamGraphExecutor for details.

What's Changed

  • Bump mlflow from 2.8.1 to 2.9.1 in /requirements by @dependabot in https://github.com/ssec-jhu/dplutils/pull/35
  • Bump mlflow from 2.9.1 to 2.9.2 in /requirements by @dependabot in https://github.com/ssec-jhu/dplutils/pull/36
  • Fix test for ray observer in executor by @amitschang in https://github.com/ssec-jhu/dplutils/pull/33
  • Bump pyarrow from 14.0.1 to 14.0.2 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/38
  • Bump sphinx-book-theme from 1.0.1 to 1.1.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/40
  • Bump sphinx from 6.2.1 to 7.2.6 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/1
  • Bump sphinx-rtd-theme from 1.3.0 to 2.0.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/37
  • Bump ruff from 0.1.6 to 0.1.10 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/42
  • Bump pandas from 2.1.3 to 2.1.4 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/41
  • Add framework for graph streaming, ray implementation by @amitschang in https://github.com/ssec-jhu/dplutils/pull/43
  • Add docstrings for new stream class, update sphinx docs by @amitschang in https://github.com/ssec-jhu/dplutils/pull/44

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.2.0...v0.3.0

- Python
Published by amitschang about 2 years ago

dplutils - dplutils-0.2.0

This release includes added observers and software dependency updates for the bundled docker reference image

What's Changed

  • Docs version and project from package metadata by @amitschang in https://github.com/ssec-jhu/dplutils/pull/21
  • Upgrade ray by @amitschang in https://github.com/ssec-jhu/dplutils/pull/20
  • Bump pyarrow from 13.0.0 to 14.0.1 in /requirements by @dependabot in https://github.com/ssec-jhu/dplutils/pull/22
  • Fix test coverage in some areas missed due to ray by @amitschang in https://github.com/ssec-jhu/dplutils/pull/23
  • Test coverage fixes for ray, bug fix by @amitschang in https://github.com/ssec-jhu/dplutils/pull/24
  • Adding missing executor tests for config by @amitschang in https://github.com/ssec-jhu/dplutils/pull/25
  • adding aim and mlflow observers by @amitschang in https://github.com/ssec-jhu/dplutils/pull/26
  • Bump numpy from 1.26.1 to 1.26.2 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/29
  • Bump ruff from 0.1.3 to 0.1.6 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/28
  • Bump tox from 4.11.3 to 4.11.4 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/31
  • Bump ray[default] from 2.8.0 to 2.8.1 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/30
  • Bump pandas from 2.1.2 to 2.1.3 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/32

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.1.3...v0.2.0

- Python
Published by amitschang about 2 years ago

dplutils - dplutils-0.1.3

What's Changed

  • Adding workflow for pypi publishing by @amitschang in https://github.com/ssec-jhu/dplutils/pull/13
  • Bump pytest from 7.4.2 to 7.4.3 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/18
  • Fixing project URLs by @amitschang in https://github.com/ssec-jhu/dplutils/pull/19
  • Bump sphinx-automodapi from 0.15.0 to 0.16.0 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/15
  • Bump ruff from 0.1.2 to 0.1.3 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/14
  • Bump build from 0.10.0 to 1.0.3 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/16
  • Bump pandas from 2.1.1 to 2.1.2 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/17

Full Changelog: https://github.com/ssec-jhu/dplutils/compare/v0.1.0...v0.1.3

- Python
Published by amitschang over 2 years ago

dplutils - pypi publish test

- Python
Published by amitschang over 2 years ago

dplutils - v0.1.0

What's Changed

  • Bump ruff from 0.0.286 to 0.1.2 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/5
  • Bump numpy from 1.26.0 to 1.26.1 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/2
  • Bump pandas from 2.1.0 to 2.1.1 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/3
  • Bump ray[default] from 2.7.0 to 2.7.1 by @dependabot in https://github.com/ssec-jhu/dplutils/pull/4
  • fixing readme badges by @amitschang in https://github.com/ssec-jhu/dplutils/pull/6
  • Restoring docker automatic build by @amitschang in https://github.com/ssec-jhu/dplutils/pull/7
  • Restoring codecov action by @amitschang in https://github.com/ssec-jhu/dplutils/pull/9
  • Fix for readthedocs by @amitschang in https://github.com/ssec-jhu/dplutils/pull/8
  • Fix for https://github.com/pydata/pydata-sphinx-theme/issues/1492 by @amitschang in https://github.com/ssec-jhu/dplutils/pull/10
  • Fix docs badge, epub docs build by @amitschang in https://github.com/ssec-jhu/dplutils/pull/11

New Contributors

  • @dependabot made their first contribution in https://github.com/ssec-jhu/dplutils/pull/5
  • @amitschang made their first contribution in https://github.com/ssec-jhu/dplutils/pull/6
  • @jamienoss created the template with build infrastructure, licensing, docs etc. See also https://github.com/ssec-jhu/base-template. Also reviewed code
  • @vkluzner reviewed code
  • @xiangchenjhu reviewed code and added documentation

Full Changelog: https://github.com/ssec-jhu/dplutils/commits/v0.1.0

- Python
Published by amitschang over 2 years ago