Data

Tools

Indexes

Applications

Experiments

Open Source Science

Recent Releases of https://github.com/datalad/datalad-metalad

https://github.com/datalad/datalad-metalad - Bugfix release

What's Changed

  • Remove redefinition of legacy extractor base-class by @christian-monch in https://github.com/datalad/datalad-metalad/pull/408

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.21...0.4.22

- Python
Published by christian-monch over 2 years ago

https://github.com/datalad/datalad-metalad - Hot-fix release

  • Use correct class to determine extractor generation by @christian-monch

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.20...0.4.21

- Python
Published by christian-monch over 2 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

What's Changed

  • Specify minimum version of importlib-metadata and importlib-resources by @christian-monch in https://github.com/datalad/datalad-metalad/pull/406

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.18...0.4.20

- Python
Published by christian-monch over 2 years ago

https://github.com/datalad/datalad-metalad - Support python 3.12 and clean up

What's Changed

  • Update versioneer by @christian-monch in https://github.com/datalad/datalad-metalad/pull/398
  • Add pre-commit package to the development requirements by @christian-monch in https://github.com/datalad/datalad-metalad/pull/399
  • Remove package six and its usage by @christian-monch in https://github.com/datalad/datalad-metalad/pull/402
  • Replace pkg_rsources with importlib.metadata by @christian-monch in https://github.com/datalad/datalad-metalad/pull/401

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.17...0.4.18

- Python
Published by christian-monch over 2 years ago

https://github.com/datalad/datalad-metalad - Improvement and bug fix release 0.4.17

What's Changed

  • NF: adds updated custom dataset+file extractors by @jsheunis in https://github.com/datalad/datalad-metalad/pull/353
  • Add generation to metadata extractors to be able to tell one from another by @yarikoptic in https://github.com/datalad/datalad-metalad/pull/351
  • BUG: fix extractor type in metadata_record by @jsheunis in https://github.com/datalad/datalad-metalad/pull/374
  • Expand tabs by @asmacdo in https://github.com/datalad/datalad-metalad/pull/369
  • BF: imports BaseMetadataExtractor from datalad-deprecated by @jsheunis in https://github.com/datalad/datalad-metalad/pull/377
  • Render result reports for meta-add if not run in batch-mode by @adswa in https://github.com/datalad/datalad-metalad/pull/358
  • BF: Raise early and informative when extracting from a non-existing file by @adswa in https://github.com/datalad/datalad-metalad/pull/355
  • Update minimal datalad-metadata-model versions by @christian-monch in https://github.com/datalad/datalad-metalad/pull/378

New Contributors

  • @asmacdo made their first contribution in https://github.com/datalad/datalad-metalad/pull/369

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.16...0.4.17

- Python
Published by christian-monch about 3 years ago

https://github.com/datalad/datalad-metalad - 0.4.16

What's Changed

  • Fix a bug in metadata adding
  • Fix man page building
  • Add a draft of a user guide on writing custom extractors by @mslw in https://github.com/datalad/datalad-metalad/pull/282
  • DOC: A variety of small improvements to the docs by @adswa in https://github.com/datalad/datalad-metalad/pull/321
  • Switch macOS appveyor builds to Monterey by @adswa in https://github.com/datalad/datalad-metalad/pull/326
  • Merge maint (0.4.12) by @yarikoptic in https://github.com/datalad/datalad-metalad/pull/337
  • DOC: Make a history page from the README by @adswa in https://github.com/datalad/datalad-metalad/pull/339
  • Codespell: adding config, workflow and fixing some typos by @yarikoptic in https://github.com/datalad/datalad-metalad/pull/336
  • Clean up historical comment that was addressed by @adswa in https://github.com/datalad/datalad-metalad/pull/342
  • Convert "Metalad first steps" gist to a docs chapter by @mslw in https://github.com/datalad/datalad-metalad/pull/352
  • Render API commands as commandline references by @adswa in https://github.com/datalad/datalad-metalad/pull/324
  • Correct comment labeling of installation through PyPi by @candleindark in https://github.com/datalad/datalad-metalad/pull/364
  • ENH: Allow DatasetMetadataExtractor.get_required_content() to return a generator by @jsheunis in https://github.com/datalad/datalad-metalad/pull/361
  • Return non-ok result records with a generic result renderer by @adswa in https://github.com/datalad/datalad-metalad/pull/357
  • MNT: Refactor extraction code by @jsheunis in https://github.com/datalad/datalad-metalad/pull/367

New Contributors

  • @mslw made their first contribution in https://github.com/datalad/datalad-metalad/pull/282
  • @candleindark made their first contribution in https://github.com/datalad/datalad-metalad/pull/364

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.12...0.4.16

- Python
Published by christian-monch about 3 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

What's Changed

  • TST: Don't error out on deprecation warnings by @adswa in https://github.com/datalad/datalad-metalad/pull/295
  • Do not try to dump a None-MRR by @christian-monch in https://github.com/datalad/datalad-metalad/pull/306
  • Move MacOS test to monterey by @christian-monch in https://github.com/datalad/datalad-metalad/pull/308
  • Check for None Metadata Root Record in search by @christian-monch in https://github.com/datalad/datalad-metalad/pull/309
  • include root-dataset and sub-dataset in UUID-set by @christian-monch in https://github.com/datalad/datalad-metalad/pull/333

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.11...0.4.12

- Python
Published by christian-monch over 3 years ago

https://github.com/datalad/datalad-metalad - Maintenance release for datalad 0.18

What's Changed

  • Use pipeline processor instances only once. by @christian-monch in https://github.com/datalad/datalad-metalad/pull/293
  • Adapt metalad to datalad 0.18 by @christian-monch in https://github.com/datalad/datalad-metalad/pull/304

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.10...0.4.11

- Python
Published by christian-monch over 3 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

bump required datalad-metadata-model version to include proper unicode filename handling

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.9...0.4.10

- Python
Published by christian-monch over 3 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

  • Add test data to package to allow remote tests of legacy extractors

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.6...0.4.7

- Python
Published by christian-monch over 3 years ago

https://github.com/datalad/datalad-metalad - Salvage old extractors

What's Changed

  • Move the extractors that were removed from datalad-core to metalad by @christian-monch in https://github.com/datalad/datalad-metalad/pull/284

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.5...0.4.6

- Python
Published by christian-monch over 3 years ago

https://github.com/datalad/datalad-metalad - Bug fix release 0.4.5

What's Changed

  • Improve meta-aggregate argument handling by @christian-monch in https://github.com/datalad/datalad-metalad/pull/280
  • Set required datalad-metadata-model version to 0.3.5 by @christian-monch in https://github.com/datalad/datalad-metalad/pull/280

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.4...0.4.5

- Python
Published by christian-monch over 3 years ago

https://github.com/datalad/datalad-metalad - Bug fix release 0.4.4

What's Changed

  • Fix number of required path arguments in meta-aggregate interface. This corrects the meta-aggreate usage-message and fixes issue #275 by @christian-monch in https://github.com/datalad/datalad-metalad/pull/279

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.3...0.4.4

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release 0.4.3

What's Changed

  • Fix issue #277: JSON output of meta-extract, which is scrambled by status-messages from subdatasets()-calls by @christian-monch in https://github.com/datalad/datalad-metalad/pull/278

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.2...0.4.3

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

What's Changed

  • Fix file-path determination if dataset-path or file-path contain symlinks by @christian-monch in https://github.com/datalad/datalad-metalad/pull/274

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.1...0.4.2

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

What's Changed

  • Support absolute intra-dataset paths and catch not-tracked errors by @christian-monch in https://github.com/datalad/datalad-metalad/pull/267
  • BF(TST): do not chdir directly, use "chpwd" helper with have by @yarikoptic in https://github.com/datalad/datalad-metalad/pull/269
  • Improve tests, fix potential errors and reduce log output by @christian-monch in https://github.com/datalad/datalad-metalad/pull/270
  • Use proper mock attributes for testing by @christian-monch in https://github.com/datalad/datalad-metalad/pull/271
  • Fix symlink issue by @christian-monch in https://github.com/datalad/datalad-metalad/pull/272
  • Prepare changelog for 0.4.1 release by @christian-monch in https://github.com/datalad/datalad-metalad/pull/273

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.4.0...0.4.1

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Paradise City

0.4.0 (Tue Jun 21 2022)

Enhancements

Bug Fix

  • Fix datalad version determination in tests (@christian-monch) Merge pull request #260 from datalad/fix-datalad-version-determination

Authors: 1

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

  • Fix the determination of the datalad version in tests code (@christian-monch)

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.3.9...0.3.10

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

  • include pipeline descriptions in package

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

  • ensure pipeline definitions are installed

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Fix pipeline installation

  • Fix a bug in the installation specification that prevented pipelines from beeing installed

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - 0.3.4

Bugfix release

  • Disable result renderer in subdataset in core extractor calls by @christian-monch in https://github.com/datalad/datalad-metalad/pull/258
  • Fix traverser-error on unresolved topleveldir path argument by @christian-monch in https://github.com/datalad/datalad-metalad/pull/259
  • Update minimal datalad metadata model version to 0.3.1 (this fixes a bug in fetching and pushing of metadata)
  • Add an automated pypi release action

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

This release fixes one bug:

  1. Issue #253 : top-level-dir argument of DatasetTraverser does not handle relative paths correctly.

- Python
Published by christian-monch almost 4 years ago

https://github.com/datalad/datalad-metalad - Bug fix release

This release fixes two bugs:

  1. Issue #245: get_required_content() was not called in dataset-level metadata extractors
  2. Issue #247: module datalad_metalad.extractors.studyminimeta was not found.

- Python
Published by christian-monch about 4 years ago

https://github.com/datalad/datalad-metalad - Fix missing requirements

Minimal release to add a missing requirement of "six"

- Python
Published by christian-monch about 4 years ago

https://github.com/datalad/datalad-metalad - Metadata handling, the next generation

This is a new suite of datalad commands to handle metadata. It includes a new storage backend, that does not interfere (and does not inter-operate) with the metadata storage system used in versions < 0.3.0.

New commands:

The following commands are new, or have a changed syntax and semantic

  • meta-add: add metadata to a repository
  • meta-dump: dump metadata stored in a repository.
  • meta-aggregate: aggregate metadata stored in sub-datasets and store it in the super-dataset
  • meta-extract: run extractors to create metadata from repository-content
  • meta-filter: run filter over all or parts of the metadata stored in a repository
  • meta-conduct: execute pipelines that process metadata, e.g. extract metadata from all files in a dataset and add it to the repository. A few pipelines are provided with the release.

New extractors and idexers:

  • studyminimeta-extractor: creates metadata from studyminimeta-files, i.e. <dataset-root>/.studyminimeta.yaml.
  • studyminimeta-indexer: creates key-value sets from studyminimeta-metadata that is optimized for datalad search.

Note

This new suite of metadata commands is more or less a complete rewrite of the previous version. The concept has evolved, the syntax and semantics of the commands have changed, and the documentation is still growing.

At the moment there is no tool to import old metadata into the new system (although that is possible by reading the old metadata, converting each entry to a metadata record and add it to the new system via meta-add). The next release is intended to provide a tool for that.

Full Changelog: https://github.com/datalad/datalad-metalad/compare/0.2.1...0.3.0

- Python
Published by christian-monch about 4 years ago

https://github.com/datalad/datalad-metalad - Fixing the worst

  • Minor release to rectify a few general things before development restarts.
  • Discontinue support for Python 2
  • custom extractor now reports files IDs
  • Various internal changes to keep pace with DataLad development
  • Prevent needless re-extraction of metadata (thanks to @adswa and @bpoldrack for analysis and fix)

- Python
Published by mih almost 6 years ago

https://github.com/datalad/datalad-metalad - Settling in

  • New runprov metadata extractor for datalad run record metadata as W3C PROV
  • meta_report() was renamed to meta_dump() to better reflect its purpose and capabilities
  • Various smallish changes for more robust and streamlined behavior

- Python
Published by mih almost 7 years ago

https://github.com/datalad/datalad-metalad - New life

Born from the ashes of a revolution.... Metadata for the win!

- Python
Published by mih about 7 years ago