Data

Tools

Indexes

Applications

Experiments

Open Source Science

dtoolcore

Core API to manage (scientific) data

https://github.com/jic-dtool/dtoolcore

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ○
    Academic publication links
  • ✓
    Committers with academic emails
    3 of 5 committers (60.0%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (15.7%) to scientific vocabulary
Last synced: 10 months ago · JSON representation

Repository

Core API to manage (scientific) data

Basic Info
  • Host: GitHub
  • Owner: jic-dtool
  • License: mit
  • Language: Python
  • Default Branch: master
  • Size: 412 KB
Statistics
  • Stars: 5
  • Watchers: 2
  • Forks: 3
  • Open Issues: 9
  • Releases: 0
Created over 9 years ago · Last pushed 10 months ago
Metadata Files
Readme Changelog License

README.rst 

Manage scientific data sets
===========================

.. |dtool| image:: https://github.com/jic-dtool/dtoolcore/blob/master/icons/22x22/dtool_logo.png?raw=True
    :height: 20px
    :target: https://github.com/jic-dtool/dtoolcore

.. |pypi| image:: https://badge.fury.io/py/dtoolcore.svg
   :target: http://badge.fury.io/py/dtoolcore
   :alt: PyPi package

.. |build| image:: https://ci.appveyor.com/api/projects/status/ifd8qrfidslvs4i3?svg=true
   :target: https://ci.appveyor.com/project/tjelvar-olsson/dtoolcore
   :alt: AppVeyor CI build status (Windows)

.. |test| image:: https://img.shields.io/github/actions/workflow/status/jic-dtool/dtoolcore/test.yml?branch=master&label=tests
    :target: https://github.com/jic-dtool/dtoolcore/actions/workflows/test.yml

.. |codecov| image:: https://codecov.io/github/jic-dtool/dtoolcore/coverage.svg?branch=master
   :target: https://codecov.io/github/jic-dtool/dtoolcore?branch=master
   :alt: Code Coverage

.. |docs| image:: https://readthedocs.org/projects/dtoolcore/badge/?version=latest
   :target: https://readthedocs.org/projects/dtoolcore?badge=latest
   :alt: Documentation Status

|dtool| |pypi| |build| |test| |test| |codecov| |docs|

- Documentation: http://dtoolcore.readthedocs.io
- GitHub: https://github.com/jic-dtool/dtoolcore
- PyPI: https://pypi.python.org/pypi/dtoolcore
- Free software: MIT License

Features
--------

- Core API for adding different types of metadata to files on disk
- Automatic generation of structural metadata
- Programmatic discovery and access of items in a dataset
- Structural metadata includes hash, size and modification time for
  subsequent integrity checks
- Ability to annotate individual files with arbitrary metadata
- Metadata stored on disk as plain text files, i.e. disk datasets
  generated using this API can be accessed without special tools
- Ability to create plugins for custom storage solutions
- Plugins for iRODS and Microsoft Azure storage backends available
- Cross-platform: Linux, Mac and Windows are all supported
- Works with Python 2.7, 3.5 and 3.6
- No external dependencies

Overview
--------

The dtoolcore project provides a Python API for managing (scientific) data.
It allows researchers to:

- Package data and metadata into a dataset
- Organise and backup datasets easily
- Find datasets of interest
- Verify the contents of datasets
- Discover and work with data programatically

Owner

  • Name: dtool
  • Login: jic-dtool
  • Kind: organization

GitHub Events

Total
  • Issues event: 6
  • Issue comment event: 7
  • Push event: 4
  • Pull request review event: 3
  • Pull request event: 6
  • Create event: 2
Last Year
  • Issues event: 6
  • Issue comment event: 7
  • Push event: 4
  • Pull request review event: 3
  • Pull request event: 6
  • Create event: 2

Committers

Last synced: over 2 years ago

All Time
  • Total Commits: 504
  • Total Committers: 5
  • Avg Commits per committer: 100.8
  • Development Distribution Score (DDS): 0.167
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Tjelvar Olsson t****n@j****k 420
Matthew Hartley m****y@c****t 32
Tjelvar Olsson t****n@g****m 28
Tjelvar Olsson o****t@n****k 22
Johannes Laurin Hoermann j****n@i****e 2
Committer Domains (Top 20 + Academic)
imtek.uni-freiburg.de: 1 nbi.ac.uk: 1 cantab.net: 1 jic.ac.uk: 1

Issues and Pull Requests

Last synced: 10 months ago

All Time
  • Total issues: 27
  • Total pull requests: 21
  • Average time to close issues: 4 months
  • Average time to close pull requests: 13 days
  • Total issue authors: 6
  • Total pull request authors: 2
  • Average comments per issue: 1.3
  • Average comments per pull request: 0.76
  • Merged pull requests: 14
  • Bot issues: 0
  • Bot pull requests: 7
Past Year
  • Issues: 2
  • Pull requests: 8
  • Average time to close issues: N/A
  • Average time to close pull requests: 3 days
  • Issue authors: 2
  • Pull request authors: 2
  • Average comments per issue: 0.0
  • Average comments per pull request: 0.5
  • Merged pull requests: 4
  • Bot issues: 0
  • Bot pull requests: 3
View more stats
Top Authors
Issue Authors
  • tjelvar-olsson (11)
  • jotelha (7)
  • mrmh2 (5)
  • pastewka (2)
  • SickSmile1 (1)
  • biologghe (1)
Pull Request Authors
  • jotelha (14)
  • dependabot[bot] (7)
Top Labels
Issue Labels
enhancement (9) bug (5)
Pull Request Labels
dependencies (7) github_actions (7)

Packages

  • Total packages: 2
  • Total downloads:
    • pypi 1,762 last-month
  • Total dependent packages: 29
    (may contain duplicates)
  • Total dependent repositories: 42
    (may contain duplicates)
  • Total versions: 51
  • Total maintainers: 2
pypi.org: dtoolcore

Core API for managing (scientific) data

  • Versions: 42
  • Dependent Packages: 4
  • Dependent Repositories: 42
  • Downloads: 1,762 Last month
Rankings
Dependent packages count: 1.8%
Dependent repos count: 2.3%
Average: 10.3%
Downloads: 10.3%
Forks count: 15.3%
Stargazers count: 21.5%
Maintainers (2)
tjelvar.olsson jotelha
Last synced: 10 months ago
conda-forge.org: dtoolcore

The dtoolcore project provides a Python API for managing (scientific) data. It allows researchers to: * Package data and metadata into a dataset * Organise and backup datasets easily * Find datasets of interest * Verify the contents of datasets * Discover and work with data programatically

  • Versions: 9
  • Dependent Packages: 25
  • Dependent Repositories: 0
Rankings
Dependent packages count: 2.4%
Average: 36.3%
Forks count: 51.3%
Stargazers count: 55.2%
Last synced: 10 months ago

Dependencies

.github/workflows/test.yml actions
  • actions/checkout v3 composite
  • actions/setup-python v2 composite
requirements.txt pypi
.github/workflows/publish.yml actions
  • actions/checkout v4 composite
  • actions/setup-python v5 composite
  • pypa/gh-action-pypi-publish release/v1 composite
pyproject.toml pypi
  • setuptools *