Releases | Open Source Science

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.6.2

What's Changed

Test on ARM by @jan-janssen in https://github.com/pyiron/executorlib/pull/778
Configure coverage in pyproject.toml by @jan-janssen in https://github.com/pyiron/executorlib/pull/779
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/pyiron/executorlib/pull/780
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/pyiron/executorlib/pull/781
Move slurm command to separate module by @jan-janssen in https://github.com/pyiron/executorlib/pull/782
Extend the features supported by getcacheexecute_command() by @jan-janssen in https://github.com/pyiron/executorlib/pull/783
Fix slurm job executor example by @jan-janssen in https://github.com/pyiron/executorlib/pull/784
Bump pysqa from 0.3.0 to 0.3.1 by @dependabot[bot] in https://github.com/pyiron/executorlib/pull/786
Bump pyzmq from 27.0.1 to 27.0.2 by @dependabot[bot] in https://github.com/pyiron/executorlib/pull/785

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.6.1...executorlib-1.6.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 4 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.6.1

What's Changed

Refactor getcacheexecutecommand() and getinterativeexecutecommand() by @jan-janssen in https://github.com/pyiron/executorlib/pull/746
Add docstring for errorlogfile by @jan-janssen in https://github.com/pyiron/executorlib/pull/747
Fix broken notebook on mybinder by @jan-janssen in https://github.com/pyiron/executorlib/pull/752
Warn when max workers is not set by @jan-janssen in https://github.com/pyiron/executorlib/pull/753
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/pyiron/executorlib/pull/754
Update integration test environment by @jan-janssen in https://github.com/pyiron/executorlib/pull/755
At least report the coverage on the command line by @jan-janssen in https://github.com/pyiron/executorlib/pull/757
Move scheduler to standalone by @jan-janssen in https://github.com/pyiron/executorlib/pull/758
Fix parallel execution for file based executor by @jan-janssen in https://github.com/pyiron/executorlib/pull/760
add notebook to explain testing and debug capabilities by @jan-janssen in https://github.com/pyiron/executorlib/pull/751
Update docstrings to improve consistency by @jan-janssen in https://github.com/pyiron/executorlib/pull/764
Remove conda default channel by @jan-janssen in https://github.com/pyiron/executorlib/pull/765
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/pyiron/executorlib/pull/766
Implement a first version of batching by @jan-janssen in https://github.com/pyiron/executorlib/pull/756
Create working directory by @jan-janssen in https://github.com/pyiron/executorlib/pull/767
Update pysqa to 0.3.0 by @jan-janssen in https://github.com/pyiron/executorlib/pull/769
Update pyzmq to 27.0.1 by @jan-janssen in https://github.com/pyiron/executorlib/pull/770
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/pyiron/executorlib/pull/772
Rename serialize_funct() by @jan-janssen in https://github.com/pyiron/executorlib/pull/774
Refactor HDF5 interface by @jan-janssen in https://github.com/pyiron/executorlib/pull/775
Rename internal plotting functions by @jan-janssen in https://github.com/pyiron/executorlib/pull/776
Add worker ID by @jan-janssen in https://github.com/pyiron/executorlib/pull/748

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.6.0...executorlib-1.6.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 5 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.6.0

What's Changed

Define error log file in resource_dict by @jan-janssen in https://github.com/pyiron/executorlib/pull/736
Increase minimum python version by @jan-janssen in https://github.com/pyiron/executorlib/pull/737
Silence error when terminating jobs by @jan-janssen in https://github.com/pyiron/executorlib/pull/738
Add terminatetasksin_cache() function to kill remaining tasks by @jan-janssen in https://github.com/pyiron/executorlib/pull/739
Extend HDF tests by @jan-janssen in https://github.com/pyiron/executorlib/pull/740
Add test for executewithpysqa() by @jan-janssen in https://github.com/pyiron/executorlib/pull/741
Add test for convertargsandkwargs() by @jan-janssen in https://github.com/pyiron/executorlib/pull/742
Extend tests for serializefuncth5() by @jan-janssen in https://github.com/pyiron/executorlib/pull/743
Extend tests for executeinsubprocess() by @jan-janssen in https://github.com/pyiron/executorlib/pull/744

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.5.3...executorlib-1.6.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 6 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.3

What's Changed

createfileexecutor() - rename backend variable by @jan-janssen in https://github.com/pyiron/executorlib/pull/713
Provide the logobjsize option in every Executor by @jan-janssen in https://github.com/pyiron/executorlib/pull/716
executetasksh5() wait for future to complete by @jan-janssen in https://github.com/pyiron/executorlib/pull/712
Add TestClusterExecutor to simplify debugging of SlurmClusterExecutor and FluxClusterExecutor by @jan-janssen in https://github.com/pyiron/executorlib/pull/714
Remove default terminate function by @jan-janssen in https://github.com/pyiron/executorlib/pull/717
skip broken mac os test by @jan-janssen in https://github.com/pyiron/executorlib/pull/719
Upgrade terminate function by @jan-janssen in https://github.com/pyiron/executorlib/pull/715
skip tests which fail on macOS by @jan-janssen in https://github.com/pyiron/executorlib/pull/720
Fix DocString in SingleNodeExecutor by @jan-janssen in https://github.com/pyiron/executorlib/pull/722
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/pyiron/executorlib/pull/730
Test with SLURM by @jan-janssen in https://github.com/pyiron/executorlib/pull/726
Difference between shutdown(wait=True) and shutdown(wait=False) by @jan-janssen in https://github.com/pyiron/executorlib/pull/721
Move cleanup of previous jobs into execute function by @jan-janssen in https://github.com/pyiron/executorlib/pull/732
remove unused parameter terminatetaskson_shutdown by @jan-janssen in https://github.com/pyiron/executorlib/pull/735

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.5.2...executorlib-1.5.3

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 6 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.2

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci[bot] in https://github.com/pyiron/executorlib/pull/700
Bump pysqa from 0.2.6 to 0.2.7 by @dependabot[bot] in https://github.com/pyiron/executorlib/pull/702
Create cache directory only during dump() by @jan-janssen in https://github.com/pyiron/executorlib/pull/706
Use a more flexible cache directory by @jan-janssen in https://github.com/pyiron/executorlib/pull/707

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.5.1...executorlib-1.5.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 6 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.1

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/689
Ignore PLC0415 by @jan-janssen in https://github.com/pyiron/executorlib/pull/692
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/691
Fix SlurmClusterExecutor bug by @jan-janssen in https://github.com/pyiron/executorlib/pull/697
SlurmClusterExecutor - create a separate working directory for each job by @jan-janssen in https://github.com/pyiron/executorlib/pull/698
SlurmClusterExecutor - resubmission of crashed jobs by @jan-janssen in https://github.com/pyiron/executorlib/pull/699

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.5.0...executorlib-1.5.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 6 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.0

What's Changed

Debug hatch update by @jan-janssen in https://github.com/pyiron/executorlib/pull/665
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/666
Bump pysqa from 0.2.5 to 0.2.6 by @dependabot in https://github.com/pyiron/executorlib/pull/667
Bump h5py from 3.13.0 to 3.14.0 by @dependabot in https://github.com/pyiron/executorlib/pull/668
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/669
[Bug] Resources should not be included in the hash by @jan-janssen in https://github.com/pyiron/executorlib/pull/672
[Feature] Log Communication overhead by @jan-janssen in https://github.com/pyiron/executorlib/pull/671
[Bug] Raise error when pysqa is not available by @jan-janssen in https://github.com/pyiron/executorlib/pull/677
[Maintenance] Remove UML environment file by @jan-janssen in https://github.com/pyiron/executorlib/pull/680
[Maintenance] Update pyzmq to 27.0.0 by @jan-janssen in https://github.com/pyiron/executorlib/pull/679
[maintenance] Always use "executorlib_cache" instead of "cache" by @jan-janssen in https://github.com/pyiron/executorlib/pull/682
[Feature] More efficient cache directory structure by @jan-janssen in https://github.com/pyiron/executorlib/pull/681
[Documentation] Explain missing dependencies in more detail by @jan-janssen in https://github.com/pyiron/executorlib/pull/685
[Documentation] Use FluxExecutor as another example by @jan-janssen in https://github.com/pyiron/executorlib/pull/686
[Documentation] Add docstrings for modules by @jan-janssen in https://github.com/pyiron/executorlib/pull/687
[Feature] Add option to overwrite cache_key by @jan-janssen in https://github.com/pyiron/executorlib/pull/676

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.4.0...executorlib-1.5.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 7 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.4.0

What's Changed

Bump hatch-vcs from 0.4.0 to 0.5.0 by @dependabot in https://github.com/pyiron/executorlib/pull/663
Fix boolean evaluation by @jan-janssen in https://github.com/pyiron/executorlib/pull/664

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.3.0...executorlib-1.4.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 7 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.3.0

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/659
Bump pysqa from 0.2.4 to 0.2.5 by @dependabot in https://github.com/pyiron/executorlib/pull/658
Define ExecutorBase in base module by @jan-janssen in https://github.com/pyiron/executorlib/pull/660
Update DocStrings by @jan-janssen in https://github.com/pyiron/executorlib/pull/662

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.2.1...executorlib-1.3.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 7 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.2.1

What's Changed

Update setuptools to 80.1.0 by @jan-janssen in https://github.com/pyiron/executorlib/pull/645
update requirement test by @jan-janssen in https://github.com/pyiron/executorlib/pull/647
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/652
Add test environment to readme by @jan-janssen in https://github.com/pyiron/executorlib/pull/649
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/655
Bump setuptools from 80.1.0 to 80.8.0 by @dependabot in https://github.com/pyiron/executorlib/pull/656
Transition from setuptools to hatchling by @jan-janssen in https://github.com/pyiron/executorlib/pull/657

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.2.0...executorlib-1.2.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 8 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.2.0

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/641
Include uml in documentation by @jan-janssen in https://github.com/pyiron/executorlib/pull/642
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/643
Adopt central API interface by @jan-janssen in https://github.com/pyiron/executorlib/pull/644

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.1.1...executorlib-1.2.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 8 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.1.1

What's Changed

Numpy Patch by @jan-janssen in https://github.com/pyiron/executorlib/pull/640

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.1.0...executorlib-1.1.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 8 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.1.0

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/629
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/631
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/632
Documentation: Explain Interface Class Hierarchy by @jan-janssen in https://github.com/pyiron/executorlib/pull/633
Clean up: Exit add explicit return by @jan-janssen in https://github.com/pyiron/executorlib/pull/635
Internal refactoring for interface classes by @jan-janssen in https://github.com/pyiron/executorlib/pull/636
Refactor Task scheduler by @jan-janssen in https://github.com/pyiron/executorlib/pull/637
Clean up: warn when functionality is not available by @jan-janssen in https://github.com/pyiron/executorlib/pull/638
Provide additional functions for import by @jan-janssen in https://github.com/pyiron/executorlib/pull/639

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.0.1...executorlib-1.1.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 8 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.0.1

What's Changed

Create CITATION.cff by @jan-janssen in https://github.com/pyiron/executorlib/pull/626
Submission to JOSS by @jan-janssen in https://github.com/pyiron/executorlib/pull/544
Bump pyzmq from 26.3.0 to 26.4.0 by @dependabot in https://github.com/pyiron/executorlib/pull/628

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-1.0.0...executorlib-1.0.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 9 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - Executorlib 1.0 Release

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 9 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.3

What's Changed

Bump pysqa from 0.2.3 to 0.2.4 by @dependabot in https://github.com/pyiron/executorlib/pull/600
Bump ipython from 9.0.0 to 9.0.2 by @dependabot in https://github.com/pyiron/executorlib/pull/602
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/603
Bump pyzmq from 26.2.1 to 26.3.0 by @dependabot in https://github.com/pyiron/executorlib/pull/604
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/605
Create cache directory by @jan-janssen in https://github.com/pyiron/executorlib/pull/601
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/607
Refactor Test Environment by @jan-janssen in https://github.com/pyiron/executorlib/pull/611
execute notebooks on mybinder by @jan-janssen in https://github.com/pyiron/executorlib/pull/610
Fix mybinder link by @jan-janssen in https://github.com/pyiron/executorlib/pull/613
Explain test environment by @jan-janssen in https://github.com/pyiron/executorlib/pull/612
fix SLURM typo by @jan-janssen in https://github.com/pyiron/executorlib/pull/609
Upload HPC notebook again by @jan-janssen in https://github.com/pyiron/executorlib/pull/614
Execute notebooks individually by @jan-janssen in https://github.com/pyiron/executorlib/pull/617
Explain Contributions and Support by @jan-janssen in https://github.com/pyiron/executorlib/pull/616
Fix threads per core when submitting to queue by @jan-janssen in https://github.com/pyiron/executorlib/pull/618
Improved error handling by @jan-janssen in https://github.com/pyiron/executorlib/pull/620
Cluster error handling by @jan-janssen in https://github.com/pyiron/executorlib/pull/621
Add integration tests for application notebooks by @jan-janssen in https://github.com/pyiron/executorlib/pull/619
Add JOSS and github stars badge to readme by @jan-janssen in https://github.com/pyiron/executorlib/pull/623
Add example for getcachedata() by @jan-janssen in https://github.com/pyiron/executorlib/pull/625

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.4.2...executorlib-0.4.3

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 9 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.2

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/595
Bump ipython from 8.32.0 to 8.33.0 by @dependabot in https://github.com/pyiron/executorlib/pull/596
Bump ipython from 8.33.0 to 9.0.0 by @dependabot in https://github.com/pyiron/executorlib/pull/597
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/598

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.4.1...executorlib-0.4.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 10 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.1

What's Changed

[Feature] Implement flux job scheduling priorities by @jan-janssen in https://github.com/pyiron/executorlib/pull/592
h5py - 3.13.0 by @jan-janssen in https://github.com/pyiron/executorlib/pull/593

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.4.0...executorlib-0.4.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.0

What's Changed

Refactor interactive argument handling by @jan-janssen in https://github.com/pyiron/executorlib/pull/585
Attach process kwargs to Executor by @jan-janssen in https://github.com/pyiron/executorlib/pull/586
Refactor interactive executor classes by @jan-janssen in https://github.com/pyiron/executorlib/pull/587
Generate UML diagram by @jan-janssen in https://github.com/pyiron/executorlib/pull/588
Fix info by @jan-janssen in https://github.com/pyiron/executorlib/pull/590
[feature] resize block allocation executor by @jan-janssen in https://github.com/pyiron/executorlib/pull/589

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.3.0...executorlib-0.4.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.3.0

What's Changed

fix pip check for optional dependencies by @jan-janssen in https://github.com/pyiron/executorlib/pull/579
Fix python 3.10 issue by @jan-janssen in https://github.com/pyiron/executorlib/pull/583
Use standard thread library by @jan-janssen in https://github.com/pyiron/executorlib/pull/580

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.2.1...executorlib-0.3.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.2.1

What's Changed

Restrict lower numpy version by @jan-janssen in https://github.com/pyiron/executorlib/pull/575
Debug error handling by @jan-janssen in https://github.com/pyiron/executorlib/pull/577

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.2.0...executorlib-0.2.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.2.0

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/556
[minor] Rename test environment variable by @jan-janssen in https://github.com/pyiron/executorlib/pull/557
Update Documentation by @jan-janssen in https://github.com/pyiron/executorlib/pull/558
Fixes for documentation by @jan-janssen in https://github.com/pyiron/executorlib/pull/560
Fix bug in README by @jan-janssen in https://github.com/pyiron/executorlib/pull/561
Update continuous integration environment by @jan-janssen in https://github.com/pyiron/executorlib/pull/563
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/571
Remove unused CI script by @jan-janssen in https://github.com/pyiron/executorlib/pull/570
Switch to codecov by @jan-janssen in https://github.com/pyiron/executorlib/pull/573
[feature] Add support for future objects in input dictionaries by @jan-janssen in https://github.com/pyiron/executorlib/pull/568
[bug] SLURM: Fix CPUs per task by @jan-janssen in https://github.com/pyiron/executorlib/pull/569
[feature] Add option to specify number of nodes by @jan-janssen in https://github.com/pyiron/executorlib/pull/565

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.1.0...executorlib-0.2.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.1.0

What's Changed

[major] Refactor the Executor interface by @jan-janssen in https://github.com/pyiron/executorlib/pull/548

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.11...executorlib-0.1.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.11

What's Changed

Bump ipython from 8.31.0 to 8.32.0 by @dependabot in https://github.com/pyiron/executorlib/pull/553
Add linting by @jan-janssen in https://github.com/pyiron/executorlib/pull/555

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.10...executorlib-0.0.11

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.10

What's Changed

[minor] Move create_executor() function to separate module by @jan-janssen in https://github.com/pyiron/executorlib/pull/550
[minor] Fix Initialization for ExecutorWithDependencies by @jan-janssen in https://github.com/pyiron/executorlib/pull/549
[minor] restructure create method by @jan-janssen in https://github.com/pyiron/executorlib/pull/551

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.9...executorlib-0.0.10

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.9

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/543
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/545
Bump pyzmq from 26.2.0 to 26.2.1 by @dependabot in https://github.com/pyiron/executorlib/pull/546

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.8...executorlib-0.0.9

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 11 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.8

What's Changed

Bump pysqa from 0.2.2 to 0.2.3 by @dependabot in https://github.com/pyiron/executorlib/pull/536
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/537
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/538
Try to fix readthedocs by @jan-janssen in https://github.com/pyiron/executorlib/pull/539
Read the docs OS update by @jan-janssen in https://github.com/pyiron/executorlib/pull/540
Bump cloudpickle from 3.1.0 to 3.1.1 by @dependabot in https://github.com/pyiron/executorlib/pull/542

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.7...executorlib-0.0.8

Scientific Software - Peer-reviewed - Python
Published by jan-janssen 12 months ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.7

What's Changed

Update Documentation by @jan-janssen in https://github.com/pyiron/executorlib/pull/531
Bump ipython from 8.30.0 to 8.31.0 by @dependabot in https://github.com/pyiron/executorlib/pull/533
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/534
Add type checking with mypy by @jan-janssen in https://github.com/pyiron/executorlib/pull/535
Fix block allocation with two or more workers hanging on failed function by @jan-janssen in https://github.com/pyiron/executorlib/pull/532

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.6...executorlib-0.0.7

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.6

What's Changed

Small readme fix by @jan-janssen in https://github.com/pyiron/executorlib/pull/507
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/510
Bump ipython from 8.29.0 to 8.30.0 by @dependabot in https://github.com/pyiron/executorlib/pull/511
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/514
Bump matplotlib from 3.9.2 to 3.9.3 by @dependabot in https://github.com/pyiron/executorlib/pull/513
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/515
Add auto merge by @jan-janssen in https://github.com/pyiron/executorlib/pull/516
Bump matplotlib from 3.9.3 to 3.9.4 by @dependabot in https://github.com/pyiron/executorlib/pull/520
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/522
Bump matplotlib from 3.9.4 to 3.10.0 by @dependabot in https://github.com/pyiron/executorlib/pull/521
Add option to save graph as PNG by @jan-janssen in https://github.com/pyiron/executorlib/pull/523
Measure time for execution and store it in the HDF5 files by @jan-janssen in https://github.com/pyiron/executorlib/pull/524
Get data from cache by @jan-janssen in https://github.com/pyiron/executorlib/pull/525
Set fluxexecutornesting in notebook by @jan-janssen in https://github.com/pyiron/executorlib/pull/526
Validate maximum number of workers for flux by @jan-janssen in https://github.com/pyiron/executorlib/pull/527
Move SLURM to separate module by @jan-janssen in https://github.com/pyiron/executorlib/pull/528
test working directory by @jan-janssen in https://github.com/pyiron/executorlib/pull/530
Add option to write flux log files by @jan-janssen in https://github.com/pyiron/executorlib/pull/519
Add validatemaxworkers_slurm method by @jan-janssen in https://github.com/pyiron/executorlib/pull/529

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.5...executorlib-0.0.6

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.5

What's Changed

Bump networkx from 3.4 to 3.4.1 by @dependabot in https://github.com/pyiron/executorlib/pull/427
Bump h5py from 3.11.0 to 3.12.1 by @dependabot in https://github.com/pyiron/executorlib/pull/413
Bump networkx from 3.4.1 to 3.4.2 by @dependabot in https://github.com/pyiron/executorlib/pull/431
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/432
Automatically set hostname_localhost by @jan-janssen in https://github.com/pyiron/executorlib/pull/433
Move cache functionality to shared by @jan-janssen in https://github.com/pyiron/executorlib/pull/434
Bump ipython from 8.28.0 to 8.29.0 by @dependabot in https://github.com/pyiron/executorlib/pull/436
Move serialize to separate module by @jan-janssen in https://github.com/pyiron/executorlib/pull/437
Add type hints for communication module by @jan-janssen in https://github.com/pyiron/executorlib/pull/439
Move getcommandpath() to separate module by @jan-janssen in https://github.com/pyiron/executorlib/pull/438
Implement Caching by @jan-janssen in https://github.com/pyiron/executorlib/pull/435
Delete SubprocessExecutor and ShellExecutor by @jan-janssen in https://github.com/pyiron/executorlib/pull/440
Version - use absolute import rather than relative by @jan-janssen in https://github.com/pyiron/executorlib/pull/442
Split shared cache in backend and frontend by @jan-janssen in https://github.com/pyiron/executorlib/pull/443
Refactor classes - highlight standalone modules by @jan-janssen in https://github.com/pyiron/executorlib/pull/444
Use os.makedirs() instead of os.mkdir() by @jan-janssen in https://github.com/pyiron/executorlib/pull/445
Cache: Add working directory parameter by @jan-janssen in https://github.com/pyiron/executorlib/pull/446
Cache: Terminate processes when closing executor by @jan-janssen in https://github.com/pyiron/executorlib/pull/447
Cache fix test by @jan-janssen in https://github.com/pyiron/executorlib/pull/449
Update shutdown() function by @jan-janssen in https://github.com/pyiron/executorlib/pull/450
Cache: Use explicit arguments for serializefuncth5() by @jan-janssen in https://github.com/pyiron/executorlib/pull/448
Cache: Implement resource dict for submit() by @jan-janssen in https://github.com/pyiron/executorlib/pull/451
Cache: Add queue test by @jan-janssen in https://github.com/pyiron/executorlib/pull/452
Use resource dict for internal communication by @jan-janssen in https://github.com/pyiron/executorlib/pull/455
Implement resource_dict for file executor by @jan-janssen in https://github.com/pyiron/executorlib/pull/456
Cache: create method by @jan-janssen in https://github.com/pyiron/executorlib/pull/459
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/461
Cache: Use absolute path for working directory by @jan-janssen in https://github.com/pyiron/executorlib/pull/462
Add additional input checks by @jan-janssen in https://github.com/pyiron/executorlib/pull/463
Add additional tests to improve coverage by @jan-janssen in https://github.com/pyiron/executorlib/pull/464
Add pysqa command which raises an exception by @jan-janssen in https://github.com/pyiron/executorlib/pull/465
Use same cache directory by @jan-janssen in https://github.com/pyiron/executorlib/pull/466
Test with Python 3.13 by @jan-janssen in https://github.com/pyiron/executorlib/pull/468
Enforce python 3.12 for documentation by @jan-janssen in https://github.com/pyiron/executorlib/pull/469
Update remaining tests to Python 3.13 by @jan-janssen in https://github.com/pyiron/executorlib/pull/470
Bump pysqa from 0.2.0 to 0.2.1 by @dependabot in https://github.com/pyiron/executorlib/pull/472
Disable Block Allocation by default by @jan-janssen in https://github.com/pyiron/executorlib/pull/473
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/475
Add option to disable_dependencies for cache by @jan-janssen in https://github.com/pyiron/executorlib/pull/477
Set maxcores and maxworkers to None by @jan-janssen in https://github.com/pyiron/executorlib/pull/478
Limit notebook timeout-minutes by @jan-janssen in https://github.com/pyiron/executorlib/pull/480
Add flux executor shutdown by @jan-janssen in https://github.com/pyiron/executorlib/pull/479
Fix resource dict in interactive jobs by @jan-janssen in https://github.com/pyiron/executorlib/pull/482
Fix working directory by @jan-janssen in https://github.com/pyiron/executorlib/pull/481
pysqa: set default jobname to pysqa by @jan-janssen in https://github.com/pyiron/executorlib/pull/483
Fix interference bug by @jan-janssen in https://github.com/pyiron/executorlib/pull/485
cloudpickle isinstance() by @jan-janssen in https://github.com/pyiron/executorlib/pull/487
Raise ValueError when requesting more cores than available by @jan-janssen in https://github.com/pyiron/executorlib/pull/489
Update validatenumberof_cores() by @jan-janssen in https://github.com/pyiron/executorlib/pull/488
Bump pysqa from 0.2.1 to 0.2.2 by @dependabot in https://github.com/pyiron/executorlib/pull/493
Write cache first by @jan-janssen in https://github.com/pyiron/executorlib/pull/492
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/494
remove unused future object by @jan-janssen in https://github.com/pyiron/executorlib/pull/497
Queuing system submission: check if the job is already waiting in the queue or currently running. by @jan-janssen in https://github.com/pyiron/executorlib/pull/499
Change Backend Names by @jan-janssen in https://github.com/pyiron/executorlib/pull/500
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/502
Test openmpi 5.0.6 by @jan-janssen in https://github.com/pyiron/executorlib/pull/503
Support threads on local backend by @jan-janssen in https://github.com/pyiron/executorlib/pull/504
New examples for the updated documentation by @jan-janssen in https://github.com/pyiron/executorlib/pull/495
Update readme by @jan-janssen in https://github.com/pyiron/executorlib/pull/506

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.4...executorlib-0.0.5

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.4

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/420
Bump networkx from 3.3 to 3.4 by @dependabot in https://github.com/pyiron/executorlib/pull/424
Bump ipython from 8.27.0 to 8.28.0 by @dependabot in https://github.com/pyiron/executorlib/pull/419
Bump mpi4py from 4.0.0 to 4.0.1 by @dependabot in https://github.com/pyiron/executorlib/pull/423
Update cloudpickle to 3.1.0 by @jan-janssen in https://github.com/pyiron/executorlib/pull/425
Update dependabot to also update binder/environment.yml by @jan-janssen in https://github.com/pyiron/executorlib/pull/426

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.3...executorlib-0.0.4

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.3

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/395
Remove conda default channel by @jan-janssen in https://github.com/pyiron/executorlib/pull/396
Rename Interface to Spawner by @jan-janssen in https://github.com/pyiron/executorlib/pull/398
Refactor Interface by @jan-janssen in https://github.com/pyiron/executorlib/pull/400
Enforce manual backend selection by @jan-janssen in https://github.com/pyiron/executorlib/pull/399
Bump ipython from 8.26.0 to 8.27.0 by @dependabot in https://github.com/pyiron/executorlib/pull/401
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/402
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/405
Remove hidden function by @jan-janssen in https://github.com/pyiron/executorlib/pull/406
Bump conda-subprocess from 0.0.4 to 0.0.5 by @dependabot in https://github.com/pyiron/executorlib/pull/408
Add trouble shooting by @samwaseda in https://github.com/pyiron/executorlib/pull/404
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/409
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/410
Bump pygraphviz from 1.13 to 1.14 by @dependabot in https://github.com/pyiron/executorlib/pull/414
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/416
Remove h5io from dependencies by @jan-janssen in https://github.com/pyiron/executorlib/pull/417
Remove conda support in executorlib by @jan-janssen in https://github.com/pyiron/executorlib/pull/418

New Contributors

@samwaseda made their first contribution in https://github.com/pyiron/executorlib/pull/404

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.2...executorlib-0.0.3

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.2

What's Changed

[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/376
Bump h5io from 0.2.3 to 0.2.4 by @dependabot in https://github.com/pyiron/executorlib/pull/379
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/380
Add support for nested flux executors by @jan-janssen in https://github.com/pyiron/executorlib/pull/382
Bump mpi4py from 3.1.6 to 4.0.0 by @dependabot in https://github.com/pyiron/executorlib/pull/383
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/384
Add docstrings and typehints with Github copilot by @jan-janssen in https://github.com/pyiron/executorlib/pull/385
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/387
Bump pyzmq from 26.0.3 to 26.1.0 by @dependabot in https://github.com/pyiron/executorlib/pull/386
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/390
Bump matplotlib from 3.9.1 to 3.9.2 by @dependabot in https://github.com/pyiron/executorlib/pull/391
Bump pyzmq from 26.1.0 to 26.1.1 by @dependabot in https://github.com/pyiron/executorlib/pull/392
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/executorlib/pull/393
Bump pyzmq from 26.1.1 to 26.2.0 by @dependabot in https://github.com/pyiron/executorlib/pull/394

Full Changelog: https://github.com/pyiron/executorlib/compare/executorlib-0.0.1...executorlib-0.0.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.1

Full Changelog: https://github.com/pyiron/executorlib/compare/pympipool-0.9.0...executorlib-0.0.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.9.0

What's Changed

Bump conda-subprocess from 0.0.2 to 0.0.4 by @dependabot in https://github.com/pyiron/pympipool/pull/366
Remove tqdm by @jan-janssen in https://github.com/pyiron/pympipool/pull/368
Bump ipython from 8.25.0 to 8.26.0 by @dependabot in https://github.com/pyiron/pympipool/pull/367
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/pympipool/pull/369
Bump matplotlib from 3.8.4 to 3.9.0 by @dependabot in https://github.com/pyiron/pympipool/pull/363
Add import sorting to ruff by @jan-janssen in https://github.com/pyiron/pympipool/pull/371
Update conda-incubator/setup-miniconda from v2 to v3 by @jan-janssen in https://github.com/pyiron/pympipool/pull/372
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/pympipool/pull/373
Bump matplotlib from 3.9.0 to 3.9.1 by @dependabot in https://github.com/pyiron/pympipool/pull/370
Rename pympipool to executorlib by @jan-janssen in https://github.com/pyiron/pympipool/pull/374

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.8.5...pympipool-0.9.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.5

What's Changed

Add input checks by @jan-janssen in https://github.com/pyiron/pympipool/pull/342
mpi4py as optional dependency by @jan-janssen in https://github.com/pyiron/pympipool/pull/343
Add FileExecutor by @jan-janssen in https://github.com/pyiron/pympipool/pull/344
move serial_cache function to backend folder by @jan-janssen in https://github.com/pyiron/pympipool/pull/345
Rename interactive backend scripts by @jan-janssen in https://github.com/pyiron/pympipool/pull/346
Call cache script based on full path by @jan-janssen in https://github.com/pyiron/pympipool/pull/347
MPI interactive add barrier before break by @jan-janssen in https://github.com/pyiron/pympipool/pull/349
Add mpi version for cache by @jan-janssen in https://github.com/pyiron/pympipool/pull/348
Rename PyMPIExecutor to PyLocalExecutor by @jan-janssen in https://github.com/pyiron/pympipool/pull/350
Executor Keyword Arguments by @jan-janssen in https://github.com/pyiron/pympipool/pull/351
Introduce a single Universal Executor by @jan-janssen in https://github.com/pyiron/pympipool/pull/352
Refactor pympipool to separate interactive and cache interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/353
Fix CI for stacked pull requests by @jan-janssen in https://github.com/pyiron/pympipool/pull/354
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/pympipool/pull/355
Bump h5io from 0.2.2 to 0.2.3 by @dependabot in https://github.com/pyiron/pympipool/pull/356
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/pympipool/pull/357
Fix dependencies bug by @jan-janssen in https://github.com/pyiron/pympipool/pull/358
Add the option to plot the task graph by @jan-janssen in https://github.com/pyiron/pympipool/pull/359
Implement many-to-one dependencies by @jan-janssen in https://github.com/pyiron/pympipool/pull/360
Add backend type by @jan-janssen in https://github.com/pyiron/pympipool/pull/361
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/pympipool/pull/362
[pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in https://github.com/pyiron/pympipool/pull/365
Add support for conda environments again by @jan-janssen in https://github.com/pyiron/pympipool/pull/364

New Contributors

@pre-commit-ci made their first contribution in https://github.com/pyiron/pympipool/pull/355

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.8.4...pympipool-0.8.5

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.4

What's Changed

Explain install AMD by @jan-janssen in https://github.com/pyiron/pympipool/pull/331
Test Openmpi 4.1.6 by @jan-janssen in https://github.com/pyiron/pympipool/pull/333
Update ruff to 0.4.5 by @jan-janssen in https://github.com/pyiron/pympipool/pull/336
Remove openmpi specific environment variables by @jan-janssen in https://github.com/pyiron/pympipool/pull/335
Benchmark remove environment variables by @jan-janssen in https://github.com/pyiron/pympipool/pull/338
Add type hints for input check by @jan-janssen in https://github.com/pyiron/pympipool/pull/339
Docstring fixes by @jan-janssen in https://github.com/pyiron/pympipool/pull/340
Add validate backend fucntion by @jan-janssen in https://github.com/pyiron/pympipool/pull/341
Release openmpi constraint - Test with openmpi 5.0 by @jan-janssen in https://github.com/pyiron/pympipool/pull/337

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.8.3...pympipool-0.8.4

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool-0.8.3

What's Changed

Add max_workers parameter for backwards compatiblity by @jan-janssen in https://github.com/pyiron/pympipool/pull/329
Add ruff linter by @jan-janssen in https://github.com/pyiron/pympipool/pull/330

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.8.2...pympipool-0.8.3

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.2

What's Changed

Test checks separately by @jan-janssen in https://github.com/pyiron/pympipool/pull/318
Create CODEOWNERS by @jan-janssen in https://github.com/pyiron/pympipool/pull/319
docs: fix typos by @jameshcorbett in https://github.com/pyiron/pympipool/pull/320
Switch to jupyter book by @jan-janssen in https://github.com/pyiron/pympipool/pull/321
Test Jupyter notebook by @jan-janssen in https://github.com/pyiron/pympipool/pull/324
Add autodoc by @jan-janssen in https://github.com/pyiron/pympipool/pull/325
Add use repository button to readthedocs by @jan-janssen in https://github.com/pyiron/pympipool/pull/327
Bump tqdm from 4.66.2 to 4.66.4 by @dependabot in https://github.com/pyiron/pympipool/pull/323
Bump pyzmq from 26.0.2 to 26.0.3 by @dependabot in https://github.com/pyiron/pympipool/pull/322

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.8.1...pympipool-0.8.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.1

What's Changed

Fix Flux Executor initialisation by @jan-janssen in https://github.com/pyiron/pympipool/pull/307
Move all schedulers to one module by @jan-janssen in https://github.com/pyiron/pympipool/pull/305
Remove unnecessary imports from init.py by @jan-janssen in https://github.com/pyiron/pympipool/pull/308
Update Benchmark to use new interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/309
Merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/310
Add DocStrings and fix counting available cores by @jan-janssen in https://github.com/pyiron/pympipool/pull/311
Fix coverage by @jan-janssen in https://github.com/pyiron/pympipool/pull/313
Raise error when resource_dict is used in function parameters by @jan-janssen in https://github.com/pyiron/pympipool/pull/314
Add support for dependent tasks by @jan-janssen in https://github.com/pyiron/pympipool/pull/306
Try submit function again by @jan-janssen in https://github.com/pyiron/pympipool/pull/316
Update notebooks by @jan-janssen in https://github.com/pyiron/pympipool/pull/317

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.8.0...pympipool-0.8.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.0

What's Changed

Fix type hint for ExecutorBroker.setprocess() by @jan-janssen in https://github.com/pyiron/pympipool/pull/290
Remove executeparalleltasks_loop() by @jan-janssen in https://github.com/pyiron/pympipool/pull/291
Add markdown syntax highlighting by @jan-janssen in https://github.com/pyiron/pympipool/pull/292
Allow the user to specify the backend by @jan-janssen in https://github.com/pyiron/pympipool/pull/294
Restructure tests by @jan-janssen in https://github.com/pyiron/pympipool/pull/295
Update flux-core to 0.59.0 by @jan-janssen in https://github.com/pyiron/pympipool/pull/296
refactor tests by @jan-janssen in https://github.com/pyiron/pympipool/pull/297
Remove duplicated setprocess() function by @jan-janssen in https://github.com/pyiron/pympipool/pull/298
Add option to specify resources during submit() call rather than on the executor level by @jan-janssen in https://github.com/pyiron/pympipool/pull/293
Update documentation by @jan-janssen in https://github.com/pyiron/pympipool/pull/300
Reduce public functions on the module level by @jan-janssen in https://github.com/pyiron/pympipool/pull/301
Update README by @jan-janssen in https://github.com/pyiron/pympipool/pull/302
Update binder build by @jan-janssen in https://github.com/pyiron/pympipool/pull/303
Bump pyzmq from 26.0.0 to 26.0.1 by @dependabot in https://github.com/pyiron/pympipool/pull/299

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.18...pympipool-0.8.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.18

What's Changed

Add type hints by @jan-janssen in https://github.com/pyiron/pympipool/pull/284
Fix type hint for threads by @jan-janssen in https://github.com/pyiron/pympipool/pull/285
Use Python 3.12 as default for continuous integration by @jan-janssen in https://github.com/pyiron/pympipool/pull/286
Bump mpi4py from 3.1.5 to 3.1.6 by @dependabot in https://github.com/pyiron/pympipool/pull/289
Set upper limit for Python version by @jan-janssen in https://github.com/pyiron/pympipool/pull/287
Bump pyzmq from 25.1.2 to 26.0.0 by @dependabot in https://github.com/pyiron/pympipool/pull/288

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.17...pympipool-0.7.18

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 1 year ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.17

What's Changed

Fix unresponsiveness by @jan-janssen in https://github.com/pyiron/pympipool/pull/279
Add info property to executor by @jan-janssen in https://github.com/pyiron/pympipool/pull/283
Add option to add additional arguments to SLURM submission scripts by @jan-janssen in https://github.com/pyiron/pympipool/pull/282

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.14...pympipool-0.7.17

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.15

What's Changed

Fix unresponsiveness by @jan-janssen in https://github.com/pyiron/pympipool/pull/279

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.14...pympipool-0.7.15

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.14

What's Changed

Fix coverage by @jan-janssen in https://github.com/pyiron/pympipool/pull/269
Fix Docstring by @jan-janssen in https://github.com/pyiron/pympipool/pull/270
merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/271
Use mpiexec only for parallel execution by @jan-janssen in https://github.com/pyiron/pympipool/pull/264
merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/272
merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/273
Call init function during interface creation by @jan-janssen in https://github.com/pyiron/pympipool/pull/266
Implement a Executor.setprocess() function to set the process by @jan-janssen in https://github.com/pyiron/pympipool/pull/268
Fix coverage by @jan-janssen in https://github.com/pyiron/pympipool/pull/274
Merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/275
fix coverage - use unittest discover by @jan-janssen in https://github.com/pyiron/pympipool/pull/278
Broker class by @jan-janssen in https://github.com/pyiron/pympipool/pull/267

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.13...pympipool-0.7.14

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.13

What's Changed

Update tqdm to 4.66.2 by @jan-janssen in https://github.com/pyiron/pympipool/pull/261

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.11...pympipool-0.7.13

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.11

What's Changed

Update hostname_localhost Docstring by @jan-janssen in https://github.com/pyiron/pympipool/pull/259
Use queue.Queue().get() rather than queue.Queue().get_nowait() by @jan-janssen in https://github.com/pyiron/pympipool/pull/247

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.10...pympipool-0.7.11

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.10

What's Changed

merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/184
merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/186
Update readthedocs environment by @jan-janssen in https://github.com/pyiron/pympipool/pull/234
docs: grammar tweaks by @jameshcorbett in https://github.com/pyiron/pympipool/pull/237
Bump pyzmq from 25.1.1 to 25.1.2 by @dependabot in https://github.com/pyiron/pympipool/pull/242
Test on older version of OSX by @liamhuber in https://github.com/pyiron/pympipool/pull/241
Delete .github/delete-merged-branch-config.yml by @jan-janssen in https://github.com/pyiron/pympipool/pull/246
Update Flux to 0.58.0 by @jan-janssen in https://github.com/pyiron/pympipool/pull/249
Migration to Python 3.12 by @jan-janssen in https://github.com/pyiron/pympipool/pull/183
Mark officially for python 3.12 ready by @jan-janssen in https://github.com/pyiron/pympipool/pull/250
update docs theme by @jan-janssen in https://github.com/pyiron/pympipool/pull/254
add additional parameter to control if hostname of localhost is used by @jan-janssen in https://github.com/pyiron/pympipool/pull/258

New Contributors

@jameshcorbett made their first contribution in https://github.com/pyiron/pympipool/pull/237

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.9...pympipool-0.7.10

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.9

What's Changed

Update deploy.yml by @jan-janssen in https://github.com/pyiron/pympipool/pull/232
Fix install dependencies by @jan-janssen in https://github.com/pyiron/pympipool/pull/233

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.8...pympipool-0.7.9

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.8

What's Changed

Use conda environment to deploy by @jan-janssen in https://github.com/pyiron/pympipool/pull/230
Debug deploy by @jan-janssen in https://github.com/pyiron/pympipool/pull/231

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.7...pympipool-0.7.8

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.7

What's Changed

Test pip no-build-isolation option by @jan-janssen in https://github.com/pyiron/pympipool/pull/229

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.6...pympipool-0.7.7

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.6

What's Changed

Implement a Shell based Executor by @jan-janssen in https://github.com/pyiron/pympipool/pull/225
Update black action by @jan-janssen in https://github.com/pyiron/pympipool/pull/227
Test lower limits of dependencies by @jan-janssen in https://github.com/pyiron/pympipool/pull/226
Switch to pyproject.toml by @jan-janssen in https://github.com/pyiron/pympipool/pull/228

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.5...pympipool-0.7.6

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.5

What's Changed

Use trusted publisher action by @jan-janssen in https://github.com/pyiron/pympipool/pull/223

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.4...pympipool-0.7.5

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.4

What's Changed

Update README.md by @jan-janssen in https://github.com/pyiron/pympipool/pull/216
Flux use test discover by @jan-janssen in https://github.com/pyiron/pympipool/pull/217
Add Mybinder example by @jan-janssen in https://github.com/pyiron/pympipool/pull/218
Fix module index by @jan-janssen in https://github.com/pyiron/pympipool/pull/220
Small fixes to docstrings by @jan-janssen in https://github.com/pyiron/pympipool/pull/221
Update setup.py by @jan-janssen in https://github.com/pyiron/pympipool/pull/222

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.3...pympipool-0.7.4

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.3

What's Changed

Merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/195
Use test discover by @jan-janssen in https://github.com/pyiron/pympipool/pull/162
Fix initialization by @jan-janssen in https://github.com/pyiron/pympipool/pull/198
Communicate before termination by @jan-janssen in https://github.com/pyiron/pympipool/pull/202
Fix working directory in SLURM by @jan-janssen in https://github.com/pyiron/pympipool/pull/201
Join Queues by @jan-janssen in https://github.com/pyiron/pympipool/pull/200
Raise error when srun is not available by @jan-janssen in https://github.com/pyiron/pympipool/pull/206
Add max_workers=1 as default parameter for all Executors by @jan-janssen in https://github.com/pyiron/pympipool/pull/209
Update DocStrings by @jan-janssen in https://github.com/pyiron/pympipool/pull/208
Add del() for Executors by @jan-janssen in https://github.com/pyiron/pympipool/pull/211
Universal executor by @jan-janssen in https://github.com/pyiron/pympipool/pull/207
Don't wait on deletion by @liamhuber in https://github.com/pyiron/pympipool/pull/214
Documentation update for 0.7.X and beyond by @jan-janssen in https://github.com/pyiron/pympipool/pull/212
Workflow tests by @liamhuber in https://github.com/pyiron/pympipool/pull/187

New Contributors

@liamhuber made their first contribution in https://github.com/pyiron/pympipool/pull/214

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.2...pympipool-0.7.3

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.2

What's Changed

Bump pyzmq from 24.0.1 to 25.1.1 by @dependabot in https://github.com/pyiron/pympipool/pull/182
Use Coveralls Github action by @jan-janssen in https://github.com/pyiron/pympipool/pull/185
Bump cloudpickle from 2.2.1 to 3.0.0 by @dependabot in https://github.com/pyiron/pympipool/pull/188
Fix interface shutdown by @jan-janssen in https://github.com/pyiron/pympipool/pull/193
Split Slurm and MPI interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/190
Update setup file by @jan-janssen in https://github.com/pyiron/pympipool/pull/189
Bump mpi4py from 3.1.4 to 3.1.5 by @dependabot in https://github.com/pyiron/pympipool/pull/181

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.1...pympipool-0.7.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.1

What's Changed

Update versioneer to 0.29 by @jan-janssen in https://github.com/pyiron/pympipool/pull/180
Pyzmq downgrade - for compatibility with maggma by @jan-janssen in https://github.com/pyiron/pympipool/pull/179

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.7.0...pympipool-0.7.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen about 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.7.0

What's Changed

Set flux python interface as primary interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/160
Remove legacy by @jan-janssen in https://github.com/pyiron/pympipool/pull/161
Bump tqdm from 4.65.0 to 4.65.1 by @dependabot in https://github.com/pyiron/pympipool/pull/164
Bump tqdm from 4.65.1 to 4.66.0 by @dependabot in https://github.com/pyiron/pympipool/pull/165
Bump pyzmq from 25.1.0 to 25.1.1 by @dependabot in https://github.com/pyiron/pympipool/pull/166
Bump tqdm from 4.66.0 to 4.66.1 by @dependabot in https://github.com/pyiron/pympipool/pull/167
Add interface_bootup() to pympipool.shared as well as the MpiExecInterface and the SlurmSubprocessInterface by @jan-janssen in https://github.com/pyiron/pympipool/pull/168
Clean up getbackendpath() by @jan-janssen in https://github.com/pyiron/pympipool/pull/169
Add Docstrings by @jan-janssen in https://github.com/pyiron/pympipool/pull/171
Broker kwargs by @jan-janssen in https://github.com/pyiron/pympipool/pull/174
Implement a central setinit_function() by @jan-janssen in https://github.com/pyiron/pympipool/pull/175
Refactor the executor by @jan-janssen in https://github.com/pyiron/pympipool/pull/176
No longer surpress error messages by @jan-janssen in https://github.com/pyiron/pympipool/pull/178

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.6.2...pympipool-0.7.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.6.2

What's Changed

Add serial backend by @jan-janssen in https://github.com/pyiron/pympipool/pull/152
Add fall back option for cloudpickle_register() by @jan-janssen in https://github.com/pyiron/pympipool/pull/153
Merge main by @jan-janssen in https://github.com/pyiron/pympipool/pull/154
Flux parallel debug by @jan-janssen in https://github.com/pyiron/pympipool/pull/155
submit multiple tasks to a broker but execute only one by @jan-janssen in https://github.com/pyiron/pympipool/pull/156
Code improvements by @jan-janssen in https://github.com/pyiron/pympipool/pull/158
Move ExecutorBase to shared modules by @jan-janssen in https://github.com/pyiron/pympipool/pull/157
Add OpenMP support by @jan-janssen in https://github.com/pyiron/pympipool/pull/149

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.6.1...pympipool-0.6.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.6.1

What's Changed

Refactor ExecutorBase by @jan-janssen in https://github.com/pyiron/pympipool/pull/144
Clean up CI by @jan-janssen in https://github.com/pyiron/pympipool/pull/145
Link python executable as sys.executable rather than python by @jan-janssen in https://github.com/pyiron/pympipool/pull/147
Enable Flux python interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/146

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.6.0...pympipool-0.6.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.6.0

What's Changed

Provide legacy import for Pool, PoolExecutor and MPISpawnPool by @jan-janssen in https://github.com/pyiron/pympipool/pull/136
Add documentation for HPCExecutor by @jan-janssen in https://github.com/pyiron/pympipool/pull/138
fix Docstring - remove depreciated arguments by @jan-janssen in https://github.com/pyiron/pympipool/pull/140
fix timeout to 5min by @jan-janssen in https://github.com/pyiron/pympipool/pull/142
Print test names - to identify stuck tests by @jan-janssen in https://github.com/pyiron/pympipool/pull/141
Add test for raising thread by @jan-janssen in https://github.com/pyiron/pympipool/pull/143
Abstraction for connection interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/139

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.8...pympipool-0.6.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.8

What's Changed

Add the ability to specify the number of GPUs by @jan-janssen in https://github.com/pyiron/pympipool/pull/125
DocString for cancelitemsin_queue() by @jan-janssen in https://github.com/pyiron/pympipool/pull/129
DocString for cloudpickle_register() by @jan-janssen in https://github.com/pyiron/pympipool/pull/130
MetaExecutor Class by @jan-janssen in https://github.com/pyiron/pympipool/pull/128
join queue at the end of each test by @jan-janssen in https://github.com/pyiron/pympipool/pull/132
move pool to legacy interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/134

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.7...pympipool-0.5.8

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.7

What's Changed

MPIPoolExecutor flux fix by @jan-janssen in https://github.com/pyiron/pympipool/pull/124

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.6...pympipool-0.5.7

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.6

What's Changed

Fix coverage by @jan-janssen in https://github.com/pyiron/pympipool/pull/121
Handle Exceptions for Futures by @jan-janssen in https://github.com/pyiron/pympipool/pull/120
Add a few words about the new pysqa interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/122
Always include the current path in the PYTHONPATH if it is not already by @jan-janssen in https://github.com/pyiron/pympipool/pull/123

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.5...pympipool-0.5.6

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.5

What's Changed

Raise exception from threads by @jan-janssen in https://github.com/pyiron/pympipool/pull/118

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.4...pympipool-0.5.5

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.4

What's Changed

Improve documentation and refactor the code base to improve readability by @jan-janssen in https://github.com/pyiron/pympipool/pull/115
Add API documentation by @jan-janssen in https://github.com/pyiron/pympipool/pull/116

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.3...pympipool-0.5.4

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.3

What's Changed

Refactor the execute_tasks...() functions by @jan-janssen in https://github.com/pyiron/pympipool/pull/112
Thread: use kwargs rather than args by @jan-janssen in https://github.com/pyiron/pympipool/pull/114
Pysqa integration by @jan-janssen in https://github.com/pyiron/pympipool/pull/113

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.2...pympipool-0.5.3

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.2

What's Changed

Fix tests by @jan-janssen in https://github.com/pyiron/pympipool/pull/107
Provide cancelitemsin_queue() as part of the API by @jan-janssen in https://github.com/pyiron/pympipool/pull/108
Connect to socket interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/110
Extend communication interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/111

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.1...pympipool-0.5.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.1

What's Changed

cleaning up the API of the Pool classes by @jan-janssen in https://github.com/pyiron/pympipool/pull/97
Communicate process is ready for shutdown by @jan-janssen in https://github.com/pyiron/pympipool/pull/98
update comments by @jan-janssen in https://github.com/pyiron/pympipool/pull/99
Wait for executor to finish execution by @jan-janssen in https://github.com/pyiron/pympipool/pull/100
Communicate wait option by @jan-janssen in https://github.com/pyiron/pympipool/pull/101
Move updatefuturedict() to separate function by @jan-janssen in https://github.com/pyiron/pympipool/pull/102
parsesocketcommunication() always return a dict by @jan-janssen in https://github.com/pyiron/pympipool/pull/103
Implement call_back() for PoolExecutor by @jan-janssen in https://github.com/pyiron/pympipool/pull/104
Specify sync interval - force short sleep by @jan-janssen in https://github.com/pyiron/pympipool/pull/105

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.5.0...pympipool-0.5.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.5.0

What's Changed

Refactor interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/64
Fix version number by @jan-janssen in https://github.com/pyiron/pympipool/pull/65
Do not overwrite submitted function arguments by @jan-janssen in https://github.com/pyiron/pympipool/pull/66
Rename Worker to Executor by @jan-janssen in https://github.com/pyiron/pympipool/pull/68
Add executor map() function test by @jan-janssen in https://github.com/pyiron/pympipool/pull/69
Set defaults for functions by @jan-janssen in https://github.com/pyiron/pympipool/pull/70
Use naming from Multiprocessing Pool by @jan-janssen in https://github.com/pyiron/pympipool/pull/71
Implement starmap by @jan-janssen in https://github.com/pyiron/pympipool/pull/72
Separate PoolBase class by @jan-janssen in https://github.com/pyiron/pympipool/pull/74
Executor does not need enter() and exit() by @jan-janssen in https://github.com/pyiron/pympipool/pull/75
Rename executetasks() to executeparallel_tasks() by @jan-janssen in https://github.com/pyiron/pympipool/pull/76
Update API by @jan-janssen in https://github.com/pyiron/pympipool/pull/78
Add executeserialtasks() by @jan-janssen in https://github.com/pyiron/pympipool/pull/77
Remove apply() and submit() from Pool by @jan-janssen in https://github.com/pyiron/pympipool/pull/79
Rename classes once again by @jan-janssen in https://github.com/pyiron/pympipool/pull/80
Add first version of documentation by @jan-janssen in https://github.com/pyiron/pympipool/pull/81
Add Readthedocs integration by @jan-janssen in https://github.com/pyiron/pympipool/pull/82
update slogan by @jan-janssen in https://github.com/pyiron/pympipool/pull/83
functions rather than programs by @jan-janssen in https://github.com/pyiron/pympipool/pull/84
Update documentation for individual interfaces by @jan-janssen in https://github.com/pyiron/pympipool/pull/85
Update documentation links in README by @jan-janssen in https://github.com/pyiron/pympipool/pull/86
Black formatting by @jan-janssen in https://github.com/pyiron/pympipool/pull/87
correct spelling mistake by @jan-janssen in https://github.com/pyiron/pympipool/pull/88
link features directly by @jan-janssen in https://github.com/pyiron/pympipool/pull/89

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.4.2...pympipool-0.5.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.4.2

What's Changed

Working directory by @jan-janssen in https://github.com/pyiron/pympipool/pull/63

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.4.1...pympipool-0.4.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.4.1

What's Changed

Measure length of queues by @jan-janssen in https://github.com/pyiron/pympipool/pull/59
Fix return values by @jan-janssen in https://github.com/pyiron/pympipool/pull/60
Always require both args and kwargs - internally by @jan-janssen in https://github.com/pyiron/pympipool/pull/62
Add internal memory by @jan-janssen in https://github.com/pyiron/pympipool/pull/61

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.4.0...pympipool-0.4.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.4.0

What's Changed

Add coverage by @pyiron-runner in https://github.com/pyiron/pympipool/pull/32
Coverage only on openmpi by @jan-janssen in https://github.com/pyiron/pympipool/pull/33
Add flux support - not yet tested for multiple compute nodes by @jan-janssen in https://github.com/pyiron/pympipool/pull/34
Move _pool_open() to __init__() by @jan-janssen in https://github.com/pyiron/pympipool/pull/35
Derive from concurrent.futures.Executor class by @jan-janssen in https://github.com/pyiron/pympipool/pull/36
Add stderr by @jan-janssen in https://github.com/pyiron/pympipool/pull/39
support more arguments by @jan-janssen in https://github.com/pyiron/pympipool/pull/40
Future by @jan-janssen in https://github.com/pyiron/pympipool/pull/37
Add common by @jan-janssen in https://github.com/pyiron/pympipool/pull/42
Add documentation and slightly refactor the interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/44
black formatting by @jan-janssen in https://github.com/pyiron/pympipool/pull/45
Add shutdown test by @jan-janssen in https://github.com/pyiron/pympipool/pull/46
move mpi4py import to main() function by @jan-janssen in https://github.com/pyiron/pympipool/pull/47
Rename main to mpimain by @jan-janssen in https://github.com/pyiron/pympipool/pull/49
import again by @jan-janssen in https://github.com/pyiron/pympipool/pull/50
More tests by @jan-janssen in https://github.com/pyiron/pympipool/pull/51
More tests by @jan-janssen in https://github.com/pyiron/pympipool/pull/52
Bump pyzmq from 25.0.2 to 25.1.0 by @dependabot in https://github.com/pyiron/pympipool/pull/53
Implement task interface by @jan-janssen in https://github.com/pyiron/pympipool/pull/54
Implement FuturePool by @jan-janssen in https://github.com/pyiron/pympipool/pull/55
Rename functions by @jan-janssen in https://github.com/pyiron/pympipool/pull/56
Use isort with black to restructure imports by @jan-janssen in https://github.com/pyiron/pympipool/pull/57

New Contributors

@pyiron-runner made their first contribution in https://github.com/pyiron/pympipool/pull/32

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.3.0...pympipool-0.4.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.3.0

What's Changed

Add Windows tests by @jan-janssen in https://github.com/pyiron/pympipool/pull/21
Close processes by @jan-janssen in https://github.com/pyiron/pympipool/pull/22
Bump tqdm from 4.64.1 to 4.65.0 by @dependabot in https://github.com/pyiron/pympipool/pull/24
Bump pyzmq from 25.0.0 to 25.0.1 by @dependabot in https://github.com/pyiron/pympipool/pull/27
Bump pyzmq from 25.0.1 to 25.0.2 by @dependabot in https://github.com/pyiron/pympipool/pull/29
Try to fix the bugs in MPI parallel sub tasks by @jan-janssen in https://github.com/pyiron/pympipool/pull/31
Enable MPI parallel sub tasks by @jan-janssen in https://github.com/pyiron/pympipool/pull/28

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.2.0...pympipool-0.3.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen over 2 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - Minor release 0.2.0

The communication interface was modified again, while maintaining backwards compatibility to previous releases: * Communicate via zmq rather than stdin and stdout, this enables support for mpich and openmpi. * Add error handling to propagate the Exception, when it is raised by mapping the function to the arguments.

What's Changed

Add support for error handling by @jan-janssen in https://github.com/pyiron/pympipool/pull/17
Support different types of errors by @jan-janssen in https://github.com/pyiron/pympipool/pull/19
Use zmq rather than stdin and stdout by @jan-janssen in https://github.com/pyiron/pympipool/pull/20

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.1.0...pympipool-0.2.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 3 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - Minor version release 0.1.0

After initial feedback the communication interface was modified, while maintaining backwards compatibility to previous releases: * Major switch of the communication interface between the serial python process and the mpi parallel python process. Previously, functions were converted to source code using inspect.getsource() and dill was used to convert the sourcecode to an binary blob which could then be transferred between the processes. In the new version, the function is directly pickled using cloudpickle as cloudpickle supports both pickle by reference and pickle by value. Here the pickle by value functionality is used to pickle the functions which is be communicated. * The documentation is updated to reflect the changes in the updated version.

What's Changed

Switch to cloudpickle by @jan-janssen in https://github.com/pyiron/pympipool/pull/15

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.0.2...pympipool-0.1.0

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 3 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - Patchrelease 0.0.2

Patches to fix bugs and maintain compatibility with the latest versions of dependencies; * output of the function which is mapped to the arguments is suppressed, as stdout interferes with the communication of pympipool. Consequently, the output of print statements is no longer visible. * support for python 3.11 is added
* mpi4py compatibility is updated from 3.1.3 to 3.1.4 * dill compatibility is updated from 0.3.5.1 to 0.3.6 * tqdm compatibility is updated from 4.64.0 to 4.64.1

What's Changed

Bump tqdm from 4.64.0 to 4.64.1 by @dependabot in https://github.com/pyiron/pympipool/pull/4
Bump dill from 0.3.5.1 to 0.3.6 by @dependabot in https://github.com/pyiron/pympipool/pull/5
Update to python 3.11 by @jan-janssen in https://github.com/pyiron/pympipool/pull/6
Bump mpi4py from 3.1.3 to 3.1.4 by @dependabot in https://github.com/pyiron/pympipool/pull/7
Update workflows by @jan-janssen in https://github.com/pyiron/pympipool/pull/9
Merge master by @jan-janssen in https://github.com/pyiron/pympipool/pull/11
Update documentation by @jan-janssen in https://github.com/pyiron/pympipool/pull/8
Surpress output by @jan-janssen in https://github.com/pyiron/pympipool/pull/14

Full Changelog: https://github.com/pyiron/pympipool/compare/pympipool-0.0.1...pympipool-0.0.2

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 3 years ago

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - Initial release 0.0.1

Initial release of the pympipool.

Full Changelog: https://github.com/pyiron/pympipool/commits/pympipool-0.0.1

Scientific Software - Peer-reviewed - Python
Published by jan-janssen almost 3 years ago

Recent Releases of Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.6.2

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.6.1

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.6.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.3

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.2

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.1

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.5.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.4.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.3.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.2.1

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.2.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.1.1

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.1.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-1.0.1

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - Executorlib 1.0 Release

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.3

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.2

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.1

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.4.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.3.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.2.1

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.2.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.1.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.11

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.10

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.9

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.8

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.7

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.6

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.5

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.4

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.3

What's Changed

New Contributors

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib 0.0.2

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - executorlib-0.0.1

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.9.0

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.5

What's Changed

New Contributors

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.4

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool-0.8.3

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.2

What's Changed

Executorlib – Up-scaling Python workflows for hierarchical heterogenous high-performance computing - pympipool 0.8.1