duqtools - 3.1.2

Small release to pin some dependencies

Full Changelog: https://github.com/duqtools/duqtools/compare/3.1.1...3.1.2

- Jupyter Notebook
Published by v1kko 11 months ago

duqtools - 3.1.1

What's Changed

• Fix small issues by @stefsmeets in https://github.com/duqtools/duqtools/pull/727
• Fix sidebar logo display by @stefsmeets in https://github.com/duqtools/duqtools/pull/729
• Update dashboard logo to use new api by @stefsmeets in https://github.com/duqtools/duqtools/pull/730
• explicitly dependencies in tests by @v1kko in https://github.com/duqtools/duqtools/pull/731

Full Changelog: https://github.com/duqtools/duqtools/compare/3.1.0...3.1.1

- Jupyter Notebook
Published by v1kko over 1 year ago

duqtools - 3.1.0

This release of duqtools overhauls the structure of the documentation, making it easier to find things, and now supports HDF5 via the IMAS access layer.

What's Changed

• Support hdf5 via acccess layer by @v1kko in https://github.com/duqtools/duqtools/pull/712
• Add quickstart documentation for the gateway by @stefsmeets in https://github.com/duqtools/duqtools/pull/705
• Update dissemination page by @stefsmeets in https://github.com/duqtools/duqtools/pull/710
• Revise documentation by @stefsmeets in https://github.com/duqtools/duqtools/pull/714

Under the hood

• Specify lookup.json via environment variable by @stefsmeets in https://github.com/duqtools/duqtools/pull/711
• Simplify systems by @v1kko in https://github.com/duqtools/duqtools/pull/703

Bug fixes

• Fix cli version crash for pypi installs by @stefsmeets in https://github.com/duqtools/duqtools/pull/704
• Fix error to be relative by @v1kko in https://github.com/duqtools/duqtools/pull/697
• Fix IMAS tests by @stefsmeets in https://github.com/duqtools/duqtools/pull/718

Maintanance

• Remove ETS6 and Jetto-v210921 systems by @stefsmeets in https://github.com/duqtools/duqtools/pull/717

Full Changelog: https://github.com/duqtools/duqtools/compare/3.0.3...3.1.0

- Jupyter Notebook
Published by stefsmeets almost 2 years ago

duqtools - 3.0.3

What's Changed

• Fix kwmain lookup crash by @stefsmeets in https://github.com/duqtools/duqtools/pull/702

Full Changelog: https://github.com/duqtools/duqtools/compare/3.0.2...3.0.3

- Jupyter Notebook
Published by stefsmeets about 2 years ago

duqtools - 3.0.2

This is a release to fix the publishing pipeline

Full Changelog: https://github.com/duqtools/duqtools/compare/3.0.1...3.0.2

- Jupyter Notebook
Published by v1kko about 2 years ago

duqtools - 3.0.1

This PR fixes a few small issues with duqtools.

What's Changed

• added jetto vector support by @v1kko in https://github.com/duqtools/duqtools/pull/688
• General bugfixes from application testing by @aaronkho in https://github.com/duqtools/duqtools/pull/689
• Update notebooks by @stefsmeets in https://github.com/duqtools/duqtools/pull/691
• Fix crash in dashboard because logo was missing from package by @stefsmeets in https://github.com/duqtools/duqtools/pull/695

Full Changelog: https://github.com/duqtools/duqtools/compare/3.0.0...3.0.1

- Jupyter Notebook
Published by stefsmeets about 2 years ago

duqtools - 3.0.0

This release of duqtools splits off the python API into its own library. This is a major change to the internals of duqtools that should not affect normal use of duqtools through the CLI. imas2xarray now handles the variable mappings to the IMAS data structure, and includes an api to load these data into xarray from hdf5. You can check it out here.

What's Changed

• Add compute_from to variable operations, and other improvements by @v1kko in https://github.com/duqtools/duqtools/pull/675
• Add option to customize axes in dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/677
• Split off imas2xarray by @stefsmeets in https://github.com/duqtools/duqtools/pull/682

Under the hood

• Prepare imas2xarray submodule by @stefsmeets in https://github.com/duqtools/duqtools/pull/680
• Single source vars by @stefsmeets in https://github.com/duqtools/duqtools/pull/684

Bug fixes

• Fix imas tests by @stefsmeets in https://github.com/duqtools/duqtools/pull/676
• Dimensions Fix: recognize that some numpy ufuncs do not have out as a keyword by @v1kko in https://github.com/duqtools/duqtools/pull/678

Maintanance

• Switch to bump-my-version by @stefsmeets in https://github.com/duqtools/duqtools/pull/686
• Directly generate coverage badge svg by @stefsmeets in https://github.com/duqtools/duqtools/pull/687

Full Changelog: https://github.com/duqtools/duqtools/compare/2.0.0...3.0.0

- Jupyter Notebook
Published by stefsmeets about 2 years ago

duqtools - 2.0.0

This version of duqtools is all about future proofing:

• It now depends on pydantic v2 and altair v5, both major dependencies requiring substantial changes to duqtools.
• The configuration and system modules were also refactored, making it easier to modify or add new systems.
• Test coverage improved to 72%, making the duqtools more robust

What's Changed

• Add option to create array submissions script and limit total number of jobs to CLI by @stefsmeets in https://github.com/duqtools/duqtools/pull/644
• Adding a sync-prominence command by @v1kko in https://github.com/duqtools/duqtools/pull/648
• Add option to run duqtools without a system by @stefsmeets in https://github.com/duqtools/duqtools/pull/659
• Update pattern to allow parsing localdb strings by @stefsmeets in https://github.com/duqtools/duqtools/pull/666

Under the hood

• Update code to support pydantic V2 by @stefsmeets in https://github.com/duqtools/duqtools/pull/653
• Update code to be compatible with Pydantic V2 by @stefsmeets in https://github.com/duqtools/duqtools/pull/654
• Update code for API change in altair v5 by @stefsmeets in https://github.com/duqtools/duqtools/pull/656
• Refactor systems by @stefsmeets in https://github.com/duqtools/duqtools/pull/660
• Refactor systems and schemas by @stefsmeets in https://github.com/duqtools/duqtools/pull/661

Bug fixes

• Fix bug and add tests for reading data.csv by @stefsmeets in https://github.com/duqtools/duqtools/pull/647
• Fix compatibility with pydantic_yaml >= 1.0.0 by @stefsmeets in https://github.com/duqtools/duqtools/pull/652
• Skip loading variable on EmptyVarError in dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/658

Maintanance

• Add Pypi trusted publishing by @v1kko in https://github.com/duqtools/duqtools/pull/649
• Update workflow to generate requirements.txt by @stefsmeets in https://github.com/duqtools/duqtools/pull/657
• Improve test coverage by @stefsmeets in https://github.com/duqtools/duqtools/pull/664
• Improve test coverage by @stefsmeets in https://github.com/duqtools/duqtools/pull/662
• Add test for duqtools merge by @stefsmeets in https://github.com/duqtools/duqtools/pull/667
• Add tests for status, setup and submit by @stefsmeets in https://github.com/duqtools/duqtools/pull/668

Full Changelog: https://github.com/duqtools/duqtools/compare/1.9.0...1.10.0

- Jupyter Notebook
Published by stefsmeets over 2 years ago

duqtools - 1.9.0

The highlight for this release is preliminary support for the ETS6 system. The operators are now more flexible, with support for upper and lower bounds, gradients, and custom functions if that is still not enough.

Note that if you are updating to this version, systems are now defined in their own block in the config:

yaml system: name: jetto ...

See the documentation for more info.

What's Changed

• Adding ets6 System for use with duqtools by @v1kko in https://github.com/duqtools/duqtools/pull/557
• Add ceiling and floor option to operator by @stefsmeets in https://github.com/duqtools/duqtools/pull/630
• Add slope to operator by @stefsmeets in https://github.com/duqtools/duqtools/pull/632
• Apply custom operator to data by @stefsmeets in https://github.com/duqtools/duqtools/pull/638

Under the hood

• Refactoring the Systems, also fixing ETS6 by @v1kko in https://github.com/duqtools/duqtools/pull/623
• Add naive copy instead of complex copy of ids data by @v1kko in https://github.com/duqtools/duqtools/pull/613
• Revise testing strategy and update python api by @stefsmeets in https://github.com/duqtools/duqtools/pull/610
• Move jruns keyword to system config by @stefsmeets in https://github.com/duqtools/duqtools/pull/634

Documentation

• Add banner to readme by @stefsmeets in https://github.com/duqtools/duqtools/pull/615
• Update logo and add it to dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/618
• Add base / uq run example to docs by @stefsmeets in https://github.com/duqtools/duqtools/pull/629

Bug fixes

• Update default for max_jobs in submit cli by @stefsmeets in https://github.com/duqtools/duqtools/pull/642
• Fix missing config error for submit by @stefsmeets in https://github.com/duqtools/duqtools/pull/641
• Get prominence working again by @v1kko in https://github.com/duqtools/duqtools/pull/635
• Fix crashes in submit / status by @stefsmeets in https://github.com/duqtools/duqtools/pull/627

Maintanance

• Move setup config to pyproject.toml by @stefsmeets in https://github.com/duqtools/duqtools/pull/608
• Avoid pip install in workflow on cache hit by @stefsmeets in https://github.com/duqtools/duqtools/pull/611
• Avoid installing typing-extensions==4.6.0 which crashes duqtools on Python 3.9 by @stefsmeets in https://github.com/duqtools/duqtools/pull/617
• Update IMAS docker workflow to only run once a week by @stefsmeets in https://github.com/duqtools/duqtools/pull/622

Full Changelog: https://github.com/duqtools/duqtools/compare/1.8.0...1.9.0

- Jupyter Notebook
Published by stefsmeets over 2 years ago

duqtools - 1.8.0

This release focuses on expanding the use-cases for duqtools. We have added a way to directly specify which operations to always apply to a dataset (operations keyword in duqtools.yaml). This will make it easier to separate 'fixes' to a dataset from sampling variables or for generating base runs.

This release also introduces a Python API, so that runs can be created and submitted from a Python script or Jupyter Notebook. For more information, see the documentation.

The duqduq CLI is also more flexible to specify which runs to create and submit, which will give more control over your data for large scale validation.

What's Changed

• Add path and imas filters for duqduq create and submit by @stefsmeets in https://github.com/duqtools/duqtools/pull/593
• Update duqtools init template by @stefsmeets in https://github.com/duqtools/duqtools/pull/594
• Add operations keyword to create config by @stefsmeets in https://github.com/duqtools/duqtools/pull/598
• Add workflow for generating base and uq runs from a single template config by @stefsmeets in https://github.com/duqtools/duqtools/pull/603
• Add python api for duqtools create and submit by @stefsmeets in https://github.com/duqtools/duqtools/pull/606

Under the hood

• Revise config loading by @stefsmeets in https://github.com/duqtools/duqtools/pull/604

Documentation

• Update contributing guidelines by @stefsmeets in https://github.com/duqtools/duqtools/pull/592
• Add documentation for setup by @stefsmeets in https://github.com/duqtools/duqtools/pull/595
• Add quickstart example to cli by @stefsmeets in https://github.com/duqtools/duqtools/pull/596
• Add option to create base run only by @stefsmeets in https://github.com/duqtools/duqtools/pull/600
• Add docs for top level keywords in config by @stefsmeets in https://github.com/duqtools/duqtools/pull/602

Bug fixes

• Remove print statement in operations.py by @v1kko in https://github.com/duqtools/duqtools/pull/589
• Do not copy restart files if restart toggle is off by @stefsmeets in https://github.com/duqtools/duqtools/pull/599
• Fixes missing keyword argument in duqduq submit -array by @stefsmeets in https://github.com/duqtools/duqtools/pull/601
• Make dashboard merge compatible with local imas database by @stefsmeets in https://github.com/duqtools/duqtools/pull/607

Maintanance

• Add linting and autoformatting for notebooks by @stefsmeets in https://github.com/duqtools/duqtools/pull/591

Full Changelog: https://github.com/duqtools/duqtools/compare/1.7.0...1.8.0

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.7.0

What's Changed

• Add duqmap function to map functions over runs/handles by @v1kko in https://github.com/duqtools/duqtools/pull/585
• Implement --max_array_size (default 100) option in duqtools submit by @v1kko in https://github.com/duqtools/duqtools/pull/584

Bug fixes

• Fixed publish pipeline by @v1kko in https://github.com/duqtools/duqtools/pull/582
• Fix bug in submit.py by @v1kko in https://github.com/duqtools/duqtools/pull/579

Maintanance

• Add action for building imas on the CI by @stefsmeets in https://github.com/duqtools/duqtools/pull/586

Full Changelog: https://github.com/duqtools/duqtools/compare/1.6.4...1.7.0

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.6.4

Bug fixes

• Docker fix and mostly a new publishing pipeline by @v1kko in https://github.com/duqtools/duqtools/pull/578

Full Changelog: https://github.com/duqtools/duqtools/compare/1.6.3...1.6.4

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.6.3

Fix paths in create.

Full Changelog: https://github.com/duqtools/duqtools/compare/1.6.2...1.6.3

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.6.2

Fixes crash introduced in 1.6.1

Full Changelog: https://github.com/duqtools/duqtools/compare/1.6.1...1.6.2

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.6.1

What's Changed

• Add a function to get all variables from a handle by @v1kko in https://github.com/duqtools/duqtools/pull/568

Bug fixes

• Update notebook for running in docker by @v1kko in https://github.com/duqtools/duqtools/pull/556
• Revert to absolute paths for duqduq create by @v1kko in https://github.com/duqtools/duqtools/pull/563
• Fix scipy to minimal version 1.09 by @v1kko in https://github.com/duqtools/duqtools/pull/561
• Exclude pydantic version 1.10.{3,4,5} by @v1kko in https://github.com/duqtools/duqtools/pull/567
• Raise error if data.csv does not have a header by @stefsmeets in https://github.com/duqtools/duqtools/pull/570
• Fix dependencies and add jinja2 requirement by @stefsmeets in https://github.com/duqtools/duqtools/pull/574
• Add a bit more info on getallvariables by @v1kko in https://github.com/duqtools/duqtools/pull/575

Full Changelog: https://github.com/duqtools/duqtools/compare/1.6.0...1.6.1

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.6.0

This is mostly a documentation update that adds several notebooks demoing how to run duqtools in different situations.

What's Changed

• Add message about number of ops that will not be submitted by @stefsmeets in https://github.com/duqtools/duqtools/pull/543

Under the hood

• Use imasdef.EMPTY_* for empty check by @stefsmeets in https://github.com/duqtools/duqtools/pull/544

Documentation

• Add notebook for single run by @stefsmeets in https://github.com/duqtools/duqtools/pull/551
• Add notebook for large scale validation by @stefsmeets in https://github.com/duqtools/duqtools/pull/553
• Add notebook for running with docker by @v1kko in https://github.com/duqtools/duqtools/pull/548
• Add notebook for running on prominence by @v1kko in https://github.com/duqtools/duqtools/pull/555

Maintanance

• Re-enable mkdocs-jupyter in docs by @stefsmeets in https://github.com/duqtools/duqtools/pull/552
• Run and update notebooks by @stefsmeets in https://github.com/duqtools/duqtools/pull/546
• Fix pypi action version by @stefsmeets in https://github.com/duqtools/duqtools/pull/537

Full Changelog: https://github.com/duqtools/duqtools/compare/1.5.0...1.6.0

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.5.0

This release of duqtools adds duqtools setup to generate single runs from a template, and duqduq merge, which automates merging large scale validation data. It is now also easier to submit jobs in a slurm array, and to restart failed jobs.

What's Changed

• Array mode supports max_jobs (default=10) by @v1kko in https://github.com/duqtools/duqtools/pull/512
• Support for relative path in runs (data.csv, runs.yaml) by @v1kko in https://github.com/duqtools/duqtools/pull/516
• Submit status filter by @stefsmeets in https://github.com/duqtools/duqtools/pull/518
• Implement duqtools setup by @stefsmeets in https://github.com/duqtools/duqtools/pull/521
• Implement duqduq merge by @stefsmeets in https://github.com/duqtools/duqtools/pull/524
• Errorbars for each data set in dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/535

Under the hood

• Pass config to queued operations where necessary by @v1kko in https://github.com/duqtools/duqtools/pull/520

Bug fixes

• Do not store relative location if run_dir not relative to current dir by @v1kko in https://github.com/duqtools/duqtools/pull/533
• Fix scientific notation in variables yaml by @stefsmeets in https://github.com/duqtools/duqtools/pull/513
• Do not filter if filter is empty by @stefsmeets in https://github.com/duqtools/duqtools/pull/522
• Force output of imas data by @stefsmeets in https://github.com/duqtools/duqtools/pull/527
• Fix duqtools submit to array by @stefsmeets in https://github.com/duqtools/duqtools/pull/529

Maintanance

• Create requirements.txt and add them to the github releases by @v1kko in https://github.com/duqtools/duqtools/pull/523
• Revert tests to use containerized_runs/main by @stefsmeets in https://github.com/duqtools/duqtools/pull/534

Full Changelog: https://github.com/duqtools/duqtools/compare/1.4.0...1.5.0

- Jupyter Notebook
Published by stefsmeets almost 3 years ago

duqtools - 1.4.0

This release of duqtools contains updates to the large scale validation tooling with duqduq and support for running jetto inside a docker container / on prominence. This version of duqtools also has better support for Jintrac v220922 and v210921 systems.

Note that this version of duqtools drops supporrt for python 3.7 and 3.8. We now target 3.9+, in sync with the IMAS/Jintrac docker container which we use for testing.

What's Changed

• Dropped support for Python 3.7 and 3.8 by @stefsmeets in https://github.com/duqtools/duqtools/pull/479
• Small enhancements for large scale validation (duqduq) by @stefsmeets in https://github.com/duqtools/duqtools/pull/477
• Implementation for jintrac v220922 by @stefsmeets in https://github.com/duqtools/duqtools/pull/487
• Added docker submit_system by @v1kko in https://github.com/duqtools/duqtools/pull/480
• Grab value from IDS for some values by @stefsmeets in https://github.com/duqtools/duqtools/pull/494
• Improve large scale validation tools by @stefsmeets in https://github.com/duqtools/duqtools/pull/483
• Implement lookup table to define IDS-to-jetto conversion by @stefsmeets in https://github.com/duqtools/duqtools/pull/502
• Add yes option to duqduq cli by @stefsmeets in https://github.com/duqtools/duqtools/pull/508
• Add tag to config schema to name jobs/runs by @stefsmeets in https://github.com/duqtools/duqtools/pull/509
• Add fine-grained status reports for duqduq and improve efficiency by @stefsmeets in https://github.com/duqtools/duqtools/pull/510

Documentation

• Update documentation of jetto system by @v1kko in https://github.com/duqtools/duqtools/pull/504
• Update documentation for large scale validation by @stefsmeets in https://github.com/duqtools/duqtools/pull/507

Under the hood

• Support adding an index at the end of a key in IDSMapping.__getitem__ by @stefsmeets in https://github.com/duqtools/duqtools/pull/500
• Write container name in duqtools lockfile for docker submit by @v1kko in https://github.com/duqtools/duqtools/pull/505

Bug fixes

• Small fixes by @v1kko in https://github.com/duqtools/duqtools/pull/475
• Fixed submit to recreate status, and scheduled submit by @v1kko in https://github.com/duqtools/duqtools/pull/495
• Raise if jetto restart files exist in template by @stefsmeets in https://github.com/duqtools/duqtools/pull/499

Maintanance

• Update .readthedocs.yaml by @stefsmeets in https://github.com/duqtools/duqtools/pull/474
• Support running tests in docker container by @stefsmeets in https://github.com/duqtools/duqtools/pull/481
• Add ruff as linter and import sorter by @stefsmeets in https://github.com/duqtools/duqtools/pull/489
• Build docs on pull request by @v1kko in https://github.com/duqtools/duqtools/pull/493

Full Changelog: https://github.com/duqtools/duqtools/compare/1.3.0...1.4.0

- Jupyter Notebook
Published by stefsmeets about 3 years ago

duqtools - 1.3.0

What's Changed

• Synchronize merge/plot options and add group common options by @stefsmeets in https://github.com/duqtools/duqtools/pull/457
• Name plot output file after grid/data variable by @stefsmeets in https://github.com/duqtools/duqtools/pull/460
• Drop support for python 3.7 and 3.8 by @stefsmeets in https://github.com/duqtools/duqtools/pull/472

Bug fixes

• fix errorbars while plotting multiple imas data by @v1kko in https://github.com/duqtools/duqtools/pull/455
• Check and abort if merge target already exists by @stefsmeets in https://github.com/duqtools/duqtools/pull/461
• Jintrac/Imas container fixes by @stefsmeets in https://github.com/duqtools/duqtools/pull/465

Maintanance

• Ci imas container by @v1kko in https://github.com/duqtools/duqtools/pull/466
• Try to cache venv by @stefsmeets in https://github.com/duqtools/duqtools/pull/470
• Update jetto tools to 1.8.8 by @stefsmeets in https://github.com/duqtools/duqtools/pull/471
• Work-around streamlit version for docker image by @stefsmeets in https://github.com/duqtools/duqtools/pull/473

Full Changelog: https://github.com/duqtools/duqtools/compare/1.2.0...1.3.0

- Jupyter Notebook
Published by stefsmeets about 3 years ago

duqtools - 1.2.0

This release changes how we deal with variables. Duqtools now automatically looks up and loads the dimensions for the variables, so they do not need to be specified anymore. Both the CLI tools for merging and plotting and the dashboard have been updated, so it should be easier to do these steps.

What's changed

• Update variable names to match variables.yaml lookup by @stefsmeets in https://github.com/duqtools/duqtools/pull/413
• Add button to download charts to dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/417
• Add citation.cff by @stefsmeets in https://github.com/duqtools/duqtools/pull/412
• Implement proof-of-concept for large scale validation by @stefsmeets in https://github.com/duqtools/duqtools/pull/423
• Squash placeholder variables when retrieving the data by @stefsmeets in https://github.com/duqtools/duqtools/pull/433
• duqtools merge --all by @v1kko in https://github.com/duqtools/duqtools/pull/435
• Plot enhancements by @v1kko in https://github.com/duqtools/duqtools/pull/437
• Enable multiple IDS in dashboard and simplify variable selection by @stefsmeets in https://github.com/duqtools/duqtools/pull/443
• Revise variable selection in merge dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/445
• Update plotting interface to handle variables better by @stefsmeets in https://github.com/duqtools/duqtools/pull/448
• Moved cfg.merge to the cli interface by @v1kko in https://github.com/duqtools/duqtools/pull/444

Bug fixes

• Fix indenting error bug by @v1kko in https://github.com/duqtools/duqtools/pull/411
• Skip time interpolation if time dimension has less than 2 values by @v1kko in https://github.com/duqtools/duqtools/pull/434
• Fix for overwriting chart names by @stefsmeets in https://github.com/duqtools/duqtools/pull/451

Documentation

• Fix docs build and add examples for jetto output config by @stefsmeets in https://github.com/duqtools/duqtools/pull/427
• Docs: added dissemination section by @v1kko in https://github.com/duqtools/duqtools/pull/430

Maintanance

• Removed queue_delete by @v1kko in https://github.com/duqtools/duqtools/pull/415
• Remove unused dependencies and conditionally depend on/import backports by @stefsmeets in https://github.com/duqtools/duqtools/pull/421
• Update flake8 repo in pre-commit config by @stefsmeets in https://github.com/duqtools/duqtools/pull/422
• Decouple runs_dir from cwd by @v1kko in https://github.com/duqtools/duqtools/pull/419
• Refactor common options parser to make it re-usable by @stefsmeets in https://github.com/duqtools/duqtools/pull/425
• Fix Github CI by @v1kko in https://github.com/duqtools/duqtools/pull/431
• Test coverage badge on gist by @stefsmeets in https://github.com/duqtools/duqtools/pull/429
• Implement VarLookup class by @stefsmeets in https://github.com/duqtools/duqtools/pull/441

Full Changelog: https://github.com/duqtools/duqtools/compare/1.1.1...1.2.0

- Jupyter Notebook
Published by stefsmeets about 3 years ago

duqtools - 1.1.1

Version 1.1.1 is a patch release that updates the documentation and fixes the output user for the merge command in the dashboard.

What's changed

• List variables by root IDS and sort alphabetically by @stefsmeets in https://github.com/duqtools/duqtools/pull/403

Bug fixes

• Fix user for output imas target when merging data in the dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/400

Documentation

• Update contributing guidelines by @stefsmeets in https://github.com/duqtools/duqtools/pull/387
• Fix broken links in documentation by @stefsmeets in https://github.com/duqtools/duqtools/pull/393
• Define landing pages for subdirectories by @stefsmeets in https://github.com/duqtools/duqtools/pull/394
• added asciinema movies to documentation by @v1kko in https://github.com/duqtools/duqtools/pull/401

Maintanance

• Fixing pipelines by @v1kko in https://github.com/duqtools/duqtools/pull/388
• Adding coverage by @v1kko in https://github.com/duqtools/duqtools/pull/396
• Test all supported python versions by @v1kko in https://github.com/duqtools/duqtools/pull/402
• Do not test 3.8 and 3.9 twice by @v1kko in https://github.com/duqtools/duqtools/pull/404

Full Changelog: https://github.com/duqtools/duqtools/compare/1.1.0...1.1.1

- Jupyter Notebook
Published by stefsmeets over 3 years ago

duqtools - 1.1.0

What's Changed

• Let jetto.sin be an optional file by @v1kko in https://github.com/duqtools/duqtools/pull/321
• Move variables out of duqtools.yaml to central config location by @stefsmeets in https://github.com/duqtools/duqtools/pull/320
• Copy pre-defined config file when duqtools init is called by @stefsmeets in https://github.com/duqtools/duqtools/pull/329
• Remove defaults that are too specific by @stefsmeets in https://github.com/duqtools/duqtools/pull/330
• Tell the user why create fails by @v1kko in https://github.com/duqtools/duqtools/pull/348
• Update duqtools clean to remove slurm array files by @stefsmeets in https://github.com/duqtools/duqtools/pull/355
• Revise CLI plot interface to make use of variable lookup table by @stefsmeets in https://github.com/duqtools/duqtools/pull/367
• Simplify getting data from ImasHandle and update notebooks by @stefsmeets in https://github.com/duqtools/duqtools/pull/382
• Variable enhancements by @stefsmeets in https://github.com/duqtools/duqtools/pull/346
• Features for Submit by @v1kko in https://github.com/duqtools/duqtools/pull/363
• Performance improvements for status --detailed by @v1kko in https://github.com/duqtools/duqtools/pull/364
• clean: be more lenient by @v1kko in https://github.com/duqtools/duqtools/pull/365
• Add reference time slice to altair plots by @stefsmeets in https://github.com/duqtools/duqtools/pull/368
• Add yolo command by @stefsmeets in https://github.com/duqtools/duqtools/pull/370
• Add cli command to recreate run from runs.yaml by @stefsmeets in https://github.com/duqtools/duqtools/pull/372
• Remove example dir and collect test data in its own directory by @stefsmeets in https://github.com/duqtools/duqtools/pull/378
• Allow empty variables to be skipped when loading xarray data by @stefsmeets in https://github.com/duqtools/duqtools/pull/384
• Add more variables to lookup table by @stefsmeets in https://github.com/duqtools/duqtools/pull/385

Under the hood

• Require jetto_tools version by @stefsmeets in https://github.com/duqtools/duqtools/pull/324
• Use jettopythontools whenever possible by @v1kko in https://github.com/duqtools/duqtools/pull/322
• Unified jetto systems into jettosystem.py by @v1kko in https://github.com/duqtools/duqtools/pull/335
• Performance improvements for status --detailed by @v1kko in https://github.com/duqtools/duqtools/pull/364
• Add explicit queued versions of ImasHandle.delete() and merge_data() by @stefsmeets in https://github.com/duqtools/duqtools/pull/386

Bug fixes

• Fix tests by @stefsmeets in https://github.com/duqtools/duqtools/pull/334
• Patch jetto.jset during create to always write IDS files by @stefsmeets in https://github.com/duqtools/duqtools/pull/371
• Fix dashboard by @stefsmeets in https://github.com/duqtools/duqtools/pull/352
• Check for required flag before showing detailed status by @stefsmeets in https://github.com/duqtools/duqtools/pull/369
• Fix the regressions in create and operations by @v1kko in https://github.com/duqtools/duqtools/pull/361
• T e var fix by @v1kko in https://github.com/duqtools/duqtools/pull/362
• Apply small code fixes by @stefsmeets in https://github.com/duqtools/duqtools/pull/380

Documentation

• Fix docs build for JettoSystem by @stefsmeets in https://github.com/duqtools/duqtools/pull/350
• Update documentation for variables and fix internal links by @stefsmeets in https://github.com/duqtools/duqtools/pull/351
• Add example scripts to documentation by @stefsmeets in https://github.com/duqtools/duqtools/pull/383
• Mention samplers and update variables section by @stefsmeets in https://github.com/duqtools/duqtools/pull/328

House keeping

• Update sonar.yaml by @v1kko in https://github.com/duqtools/duqtools/pull/306
• Disable codecov annotations in pull requests by @v1kko in https://github.com/duqtools/duqtools/pull/327
• Use markdown-include to re-use files in docs by @stefsmeets in https://github.com/duqtools/duqtools/pull/331
• Update links in code to new repo location by @stefsmeets in https://github.com/duqtools/duqtools/pull/376
• Move scripts out to their own repo by @stefsmeets in https://github.com/duqtools/duqtools/pull/375

Full Changelog: https://github.com/duqtools/duqtools/compare/1.0.0...1.1.0

- Jupyter Notebook
Published by stefsmeets over 3 years ago

duqtools - 1.0.0

The first major release of duqtools. Duqtools is a tool for Dynamic Undertainty Quantification for Tokamak reactor simulations modelling.

Features:

• Set up 100s of simulation runs from a single template
• Launch stardard sets of sensitivy tests with minimal programming
• Batch job submission and status tracking
• Supports the Standardized Interface Data Structures (IDSs) data directory
• Compare and visualize 100s of simulations in one overview
• Display simulation results as confidence ranges and distributions

What's Changed

• Add job scheduler by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/267
• Implement option for max jobs to submit by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/265
• Add cli switch to limit standard output by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/261
• Allowing for multiple * selectors in the variable path for xarray by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/268
• Create jettopythontools backend for duqtools by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/276
• Allow for inline specification of Jetto Lookup by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/288
• Major modification to analysis script compareimruns.py by @aaronkho in https://github.com/CarbonCollective/fusion-dUQtools/pull/291
• Update scripts by @Marinmepfl in https://github.com/CarbonCollective/fusion-dUQtools/pull/245

Under the hood

• Added JettoOperation(Dim) by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/283
• Coupled dimensions + tstart, tend lookup tables by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/292
• Don't expand variables in config by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/290
• Added small imas test by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/295
• Standardize time function by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/298

Bug fixes

• Fixes crash in merge subcommand by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/272
• Filter pydantic-yaml explicit root warning by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/273
• Fix documentation build by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/280
• Deterministic parsing order for common options for cli by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/281
• bugfixes found by sonarcloud by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/296
• Fix plot by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/299

Documentation

• Add community guidelines by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/274
• Update documentation by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/302

House keeping

• Depend on jetto-pythontools from pypi by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/284
• Remove dead code by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/270
• Add sonarcloud badge by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/275
• Upload to codecov.io by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/277
• Run codecov on main by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/278
• Added codecov.yml by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/279
• Only run sonarcloud on PRs ready for review by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/304
• Condensed tests, removed superfluous test by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/294
• More specific sonarcloud flow by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/297

Full Changelog: https://github.com/CarbonCollective/fusion-dUQtools/compare/0.3.0...1.0.0

- Jupyter Notebook
Published by stefsmeets over 3 years ago

duqtools - 0.3.0

What's Changed

• Add manager to couple settings between jetto.jset, jetto.in by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/230
• Add quiet flag to operations by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/244
• Add implementation for xarray as in-memory data format by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/242
• Revise how IDS data paths are defined in config by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/251
• Refactor merge subcommand using xarray datasets by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/252
• Enable plot command to output to png, pdf by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/222
• Specify run in rebase functions by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/224
• Move jintrac settings config vars to data subdir by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/236
• Revise merge command config by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/234
• Generalize IDS support in create command step by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/238
• Enable multiple time slices in create command by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/241
• Get llcmd parameters from parameters of template system by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/233
• Set all log handlers to specified level by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/243
• Script develop by @Marinmepfl in https://github.com/CarbonCollective/fusion-dUQtools/pull/213

Bug fixes

• Ids mapping fixes by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/223
• Status fix by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/231
• Fix member checking and improve error messages by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/248
• Fix crash in create and write correct build name to llcmd by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/258
• Fix dashboard by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/256

Documentation

• Add download link for jupyter notebooks in docs by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/237
• Update documentation for scaling to lower/upper error by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/259
• Update example notebooks by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/253
• Add notebook demoing 2D interpolation by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/255

House keeping

• Add hook to check notebook execution order by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/260

New Contributors

• @Marinmepfl made their first contribution in https://github.com/CarbonCollective/fusion-dUQtools/pull/213

Known issues

• Plot command is broken https://github.com/CarbonCollective/fusion-dUQtools/issues/257

Full Changelog: https://github.com/CarbonCollective/fusion-dUQtools/compare/0.2.0...0.3.0

- Jupyter Notebook
Published by stefsmeets over 3 years ago

duqtools - 0.2.0

What's Changed

• Specify values as range and add error scaling by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/187
• Split template location by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/189
• Combine multiple IMAS db entries into single one by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/164
• major scripts update with bug corrections and new functionalities by @aaronkho in https://github.com/CarbonCollective/fusion-dUQtools/pull/192
• Operations queue by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/191
• Better text output for operations by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/197
• Remove comments from yaml by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/200
• Enable setting values in IDSMapping by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/204
• Finalize merge feature in dashboard by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/206
• Convenience fixes by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/208
• Add run directory path to jetto.jset by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/181
• Add flag to add comments to config by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/182

Bug fixes

• Set error band extent to 'stdev' to fix notches by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/184

Documentation

• Update usage and installation instructions on docs by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/186
• Update, document, and demonstrate Python API by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/212
• Fixed documentation formatting issue by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/193
• Fix documentation build on readthedocs by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/203

Refactoring

• Refactor ImasLocation by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/165
• Refactor matrix samplers by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/167
• Refactor CLI schema by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/168
• Refactor System and WorkDirectory schemas by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/169
• Refactor ops sampler by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/180
• Refactor dry_run, improved tests by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/171
• System refactor by @v1kko in https://github.com/CarbonCollective/fusion-dUQtools/pull/166
• Update dashboard to use refactored API by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/183
• Fix remaining refactoring issues by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/185
• Refactor dashboard and plotting tool by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/195

House-keeping

• Upload to pypi by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/190
• Increase maximum line length to 96 by @stefsmeets in https://github.com/CarbonCollective/fusion-dUQtools/pull/199

Full Changelog: https://github.com/CarbonCollective/fusion-dUQtools/compare/0.1.0...0.2.0

- Jupyter Notebook
Published by stefsmeets over 3 years ago

duqtools - 0.1.0

First release of duqtools.

- Jupyter Notebook
Published by stefsmeets over 3 years ago