open-mastr - v0.15.0

What's Changed

• Delete content belonging to old paper by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/561
• Add static link of header image #585 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/587
• Create Release Issue Template #581 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/589
• Update issue template #588 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/593
• 594 stop using google font for mkdocs page by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/599
• [Feature #546]: Increase parsing speed by 47% by efficiently reading and writing the XML by @AlexandraImbrisca in https://github.com/OpenEnergyPlatform/open-MaStR/pull/598
• [Feature #600]: Use multiprocessing to speed up the parsing by @AlexandraImbrisca in https://github.com/OpenEnergyPlatform/open-MaStR/pull/601
• Extend list of references by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/608
• Improve docs on how to connect to custom DB by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/609
• 611 multiple mastr download links by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/613
• Add columns from the current MaStR release 25.1.158 #607 by @pt-kkraemer in https://github.com/OpenEnergyPlatform/open-MaStR/pull/618
• 610 tidy up the repository by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/619
• Add new columns to orm.py #620 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/621
• Limit the recommended number of workers by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/628
• Update pypi publish workflows by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/631
• Release v0.15.0 by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/633

New Contributors

• @AlexandraImbrisca made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/598
• @pt-kkraemer made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/618

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.5...v0.15.0

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 8 months ago

open-mastr - v0.14.5

What's Changed

• Fix workflow usercff by @chrwm in https://github.com/OpenEnergyPlatform/open-MaStR/pull/545
• Fix 549 docs on user defined output path by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/550
• Fix 553 pandas numpy version by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/554
• Feature 556 configurable api service port by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/557
• Add OFFIS as partner to README by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/493
• Feature 562 export storage units by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/565
• Add deleted_market_actors to data model by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/575
• Explain cleansing process #567 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/568
• Replace values in NetzbetreiberpruefungStatus with values from Katalogwerte by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/583

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.4...v0.14.5

Scientific Software - Peer-reviewed - Python
Published by nesnoj about 1 year ago

open-mastr - v0.14.4

What's Changed

• Feature 521 fix documentation by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/523
• Improves metadata from pyproject.toml by @maurerle in https://github.com/OpenEnergyPlatform/open-MaStR/pull/525
• Add open-mastr user agent to bulk download requests by @maurerle in https://github.com/OpenEnergyPlatform/open-MaStR/pull/526
• Extend documentation based on joss review by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/527
• Add usercff workflow by @chrwm in https://github.com/OpenEnergyPlatform/open-MaStR/pull/529
• Repair xml download from yesterday that misses gen url by @wok77 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/534
• Add imposter syndrom disclaimer by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/537
• Repair broken link in docs by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/536

New Contributors

• @maurerle made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/525
• @wok77 made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/534

Special Thanks to our JOSS Reviewers

• @cpschau
• @rafmudaf

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.3...v0.14.4

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 over 1 year ago

open-mastr - v0.14.3

What's Changed

• Delete broken tests #511 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/512
• Bugfix #505 remove deprecated functions by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/506
• Feature #487 deprecate old features by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/492
• bugfix #509 Create new table changed_dso_assignment by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/510

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.2...v0.14.3

Scientific Software - Peer-reviewed - Python
Published by chrwm over 1 year ago

open-mastr - v0.14.2

Note: This release is not published on pypi as we have currently problems with our tests!

What's Changed

• Release changes to develop by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/476
• Update urls of example projects by @nesnoj in https://github.com/OpenEnergyPlatform/open-MaStR/pull/481
• Hotfix #482 changed data types - PR for Develop by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/484
• Remove webscraping for URL by @Johann150 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/488
• Bugfix #494 handle xml syntax errors by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/495
• Bugfix #485 depcreation pandasdataframeapplymap by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/491
• Delete unused docker file #500 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/501
• Review web service update: WSDL Patchnotes V24.1.128 by @chrwm in https://github.com/OpenEnergyPlatform/open-MaStR/pull/499
• Release v0.14.2 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/504

New Contributors

• @Johann150 made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/488

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.1...v0.14.2

Scientific Software - Peer-reviewed - Python
Published by chrwm over 1 year ago

open-mastr - v0.14.1

[v0.14.1] Hotfix - 2023-01-17

What's Changed

• Hotfix #482 - Change data types by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/483

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.14.0...v0.14.1

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 almost 2 years ago

open-mastr - v0.14.0

[v0.14.0] Shiny New Documentation Page - 2023-11-22

What's Changed

• Hotfix 439 - Develop merge missing table by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/443
• Allow custom output path specification by @chrwm in https://github.com/OpenEnergyPlatform/open-MaStR/pull/402
• Update workflow #444 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/445
• Add validation scripts #437 by @deniztepe in https://github.com/OpenEnergyPlatform/open-MaStR/pull/438
• Bugfix 453 readthedocs by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/454
• Feature 449 existing date parameter by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/452
• Bugfix #466 Web service update by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/472
• Add ArtDerFlaecheIds to replaced columns #463 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/464
• Create Mastr.translate method #461 by @Grazvy in https://github.com/OpenEnergyPlatform/open-MaStR/pull/471
• Alter way to catch missing columns error #469 by @FlorianK13 in https://github.com/OpenEnergyPlatform/open-MaStR/pull/470
• Update documentation by @chrwm in https://github.com/OpenEnergyPlatform/open-MaStR/pull/460

New Contributors

• @Grazvy made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/471

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.13.2...v0.14.0

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 about 2 years ago

open-mastr - v0.13.2

## [v0.13.2] Hotfix - 2023-08-07

### Changed - Changed the name of the bulk tables for technology=gsgk #456

Compare versions: v0.13.1 - v0.13.2

Also see CHANGELOG.md

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 over 2 years ago

open-mastr - v0.13.1

Added

• Add new table and new columns to the data model #440

Compare versions: v0.13.0 - v0.13.1

Also see CHANGELOG.md

Scientific Software - Peer-reviewed - Python
Published by chrwm over 2 years ago

open-mastr - v0.13.0

[v0.13.0] Maintenance release - 2023-02-16

Added

• Add a workflow_dispatch to run CI pipelines from a button click #389
• Update version number with bump2version #407
• Add usage examples to Readme #419
• Check if the zipped file is corrupted #422
• Add Issue and PR Templates #428

Changed

• Repair the csv export #384
• Refactor csv export for better maintainability #401
• Replace numeric value in hydro_extended #392
• Fix DB query errors when using SQLAlchemy v2.0 #405
• New columns introduced #409
• Replace numeric value in combustion #413
• Filenames.yml is created everytime Mastr class is called #415
• Omit connectionless DB query (SQLAlchemy v2.0 compatibility) #421

Removed

• Option to filter & export by parameter StatistikFlag #401
• Removed unused package pynodo from dependencies #424
• Removed feature for dockered databases #426

New Contributors

• @nesnoj made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/397
• @steull made their first contribution in https://github.com/OpenEnergyPlatform/open-MaStR/pull/428

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.12.1...v0.13.0

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 almost 3 years ago

open-mastr - v0.12.1

[v0.12.1] Patch release - 2022-11-15

Added

• Add workflows to release on PyPI and Test-PyPI #375 ### Changed
• Change error handling for missing tables in postgres #370 ### Removed

Compare versions: v0.12.0...v0.12.1

Also see: CHANGELOG.md

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 about 3 years ago

open-mastr - v0.12.0

[v0.12.0] Minor release - 2022-11-07

Added

• New table deleted_units #360
• Constants.py for central hardcoded variables #345

Changed

• Handle case for empty list #362
• Fix bug occuring for permit and location download from the bulk download source #358
• Update documentation for readthedocs #356
• Update release procedure #355
• Update README.md to README.rst #354
• Technology parameter is renamed to data for better comprehension #337
• Update ORM and documentation according to wsdl patch V1.2.87 #352
• Date parameters are united into one parameter #353
• Dataversion folder entails export date#347

Removed

• Removed code artefacts #335

Compare versions: v0.11.7...v0.12.0

Also see: CHANGELOG.md

Scientific Software - Peer-reviewed - Python
Published by chrwm about 3 years ago

open-mastr - v0.11.7

[v0.11.7] Patch - Repair package - 2022-08-25

Changed

Fix dependencies in setup.py https://github.com/OpenEnergyPlatform/open-MaStR/pull/341

Compare versions: v0.11.6 - v0.11.7 Also see CHANGELOG.md

Scientific Software - Peer-reviewed - Python
Published by Ludee over 3 years ago

open-mastr - v0.11.6

Patch - Repair package - 2022-08-17 Combined changes from v0.11.5 and v0.11.6

What's Changed

• Delete the MastrDownloadFactory class #292
• Use exclusively sqlalchemy for dialect-free implementation #289
• API Download: Linked units in table permit are written in comma seperated string #302
• API Download: Repaired Location download #303
• CSV export: Tables with mastr_data about power units are exported in chunks #306
• API Download: User credentials are now tested before the download starts #309
• Pre-commit hook for Black formatting #312
• Repair technology paramter in API download #327

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.11.5...v0.11.6

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 over 3 years ago

open-mastr - v0.11.4

[v0.11.4] Patch - Hotfix - 2022-07-08

Changed

• Move function cleaneddata to dataio #284

Full Changelog: https://github.com/OpenEnergyPlatform/open-MaStR/compare/v0.11.3...v0.11.4

Scientific Software - Peer-reviewed - Python
Published by FlorianK13 over 3 years ago

open-mastr - v0.11.3

[v0.11.3] Patch - A data release - 2022-07-07

Added

• Add warning message if the bulk download speed falls below a certain limit #256
• Add engine parameter for master class initialisation #270 ### Changed
• Fix combustion mapping #253
• Update bulk parsing order #257
• Apply csv method to all tables #275

Scientific Software - Peer-reviewed - Python
Published by Ludee over 3 years ago

open-mastr - v0.11.2

[v0.11.2] Patch - Patch the package - 2022-05-17

Changed

• Update readme.md to improve PyPi release #249
• Rename branches dev -> develop and master -> production

Scientific Software - Peer-reviewed - Python
Published by Ludee over 3 years ago

open-mastr - v0.11.1

[v0.11.0] 2022-05-16

The code becomes a python package and will be available on pypi.org Additionally, a new datasource was identified and can be used: the xml bulk download. The API was updated to the newest version and the data model was adapted.

Added

• The class :class:open_mastr.mastr.Matr was introduced as the entrypoint for users, the API download was included in this entrypoint #203
• A method for downloading and parsing the xml dump from the MaStR website was implemented #202
• New data classes and attributes were introduced to orm.py #209
• The documentation page was updated
• Unit tests were created #207
• A CI pipeline was introduced #208
• The metadata was updated #219

[v0.10.0] 2020-10-08 - unreleased

A complete refactoring took place! Downloading data was entirely changed; introducing layers of code and removing duplicated code while more of less following DRY. Moreover, post-processing was changed to be more accessible and easier to execute. For example, docker now helps to spin up a database container. The documention on RTD was extended, update and improved to be more helpful for new users. Read more about the details:

Added

• added more technologies
• added documentation for ReadTheDocs
• improved parallel download

• merged all stale branches

• The class :class:open_mastr.soap_api.mirror.MaStRMirror was introduced for mirroring MaStR data with latest updates #149

• Introduce project home ~/.open-MaStR/config/ #120

• Documentation of post-processing #117

• Updated documentation of downloading data #124 which is harmonized with the other parts of docs and with GitHubs README #135

• Local execution of post-processing now possible, optionally in dockered database #116

• Post-processing adapted to CSV data from :class:open_mastr.soap_api.mirror.MaStRMirror #172

• Tests for changed download code are added #131

• Metadata added for raw data as frictionless data package #160

• Suffix columns instead of deferring in database CSV export #157

• Code examples added for :class:open_mastr.soap_api.mirror.MaStRMirror explaining basic use of mirroring database #164

• CSV file reader for MaStR raw data added #181

• Zenodo data upload #173 and the missing LICENSE file for Zenodo is fixed in #186

• Add postgres database service in CI job for interacting with database in tests #159

• Tests for :class:open_mastr.soap_api.mirror.MaStRMirror #191

• Download functionality for Lokationen (with focus on :class:open_mastr.soap_api.mirror.MaStRMirror) #162

• The CHANGELOG is now included in the documentation

Changed

• Download of raw data has entirely been refactored. A python wrapper for querying the MaStR API was introduced #83
• Based on that, for bulk data download, MaStRDownload provides handy query functions for power unit data #86. See also #128
• configuration through config filen in ~/.open-MaStR/config/ with less hard-coded parameters in source files #120, #112
• move code into one package named open_mastr #123
• Switch to GitHub Actions for CI instead of Travis #143
• Fixed unexpected line breaks during CSV export that corrupted data #170
• Filtering of duplicates in MaStR data (see MaStR help <https://www.marktstammdatenregister.de/MaStRHilfe/subpages/statistik.html>_) got changed to filter units by leading three characters and select only directly entered data #180
• Generalize CSV reading function #188

Removed

• Most of prior code for downloading data

Scientific Software - Peer-reviewed - Python
Published by Ludee over 3 years ago

open-mastr - v0.9.0

Added

• docstrings for functions
• tests
• setup.py file
• added update function (based on latest timestamp in powerunits csv)
• added wind functions
  • only download power units for wind to avoid massive download
  • changed : process units wind ("one-click solution")
• added loop to retry failed power unit downloads, currently one retry
• write failed downloads to file

Changed

• rename import-api soap_api
• update README with instruction for tests
• update README with instruction for setup

Removed

• unused imports
• obsolete comments

Fixed

• power unit update
• filter technologies from power units

Scientific Software - Peer-reviewed - Python
Published by Bachibouzouk about 6 years ago