Data

Tools

Indexes

Applications

Experiments

Open Source Science

dl1-data-handler

DL1 HDF5 format IACT data writer + reader + processor

https://github.com/cta-observatory/dl1-data-handler

Science Score: 46.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ○
    CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ○
    DOI references
  • ✓
    Academic publication links
    Links to: zenodo.org
  • ✓
    Committers with academic emails
    2 of 19 committers (10.5%) from academic institutions
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (13.1%) to scientific vocabulary
Last synced: 7 months ago · JSON representation

Repository

DL1 HDF5 format IACT data writer + reader + processor

Basic Info
  • Host: GitHub
  • Owner: cta-observatory
  • License: mit
  • Language: Jupyter Notebook
  • Default Branch: main
  • Homepage:
  • Size: 19.3 MB
Statistics
  • Stars: 12
  • Watchers: 17
  • Forks: 19
  • Open Issues: 11
  • Releases: 42
Created over 9 years ago · Last pushed 8 months ago
Metadata Files
Readme License Authors Zenodo

README.rst 

DL1 Data Handler
================


.. image:: https://zenodo.org/badge/72042185.svg
   :target: https://zenodo.org/badge/latestdoi/72042185
   :alt: DOI


.. image:: https://anaconda.org/ctlearn-project/dl1_data_handler/badges/version.svg
   :target: https://anaconda.org/ctlearn-project/dl1_data_handler/
   :alt: Anaconda-Server Badge


.. image:: https://img.shields.io/pypi/v/dl1-data-handler
    :target: https://pypi.org/project/dl1-data-handler/
    :alt: Latest Release


.. image:: https://github.com/cta-observatory/dl1-data-handler/actions/workflows/python-package-conda.yml/badge.svg
    :target: https://github.com/cta-observatory/dl1-data-handler/actions/workflows/python-package-conda.yml
    :alt: Continuos Integration

A package of utilities for reading and applying image processing to `Cherenkov Telescope Array Observatory (CTAO) `_ R1/DL0/DL1 data in a standardized format. Created primarily for testing machine learning image analysis techniques on IACT data.

Currently supports ctapipe  >= v6.0.0 data format. 

Previously named image-extractor (v0.1.0 - v0.6.0). Currently under development, intended for internal use only.


Installation
------------

The following installation method (for Linux) is recommended:

Installing as a conda package
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

To install dl1-data-handler as a conda package, first install Anaconda by following the instructions here: https://www.anaconda.com/distribution/.

The following command will set up a conda virtual environment, add the
necessary package channels, and install dl1-data-handler specified version and its dependencies:

.. code-block:: bash

   DL1DH_VER=0.14.5
   wget https://raw.githubusercontent.com/cta-observatory/dl1-data-handler/v$DL1DH_VER/environment.yml
   conda env create -n [ENVIRONMENT_NAME] -f environment.yml
   conda activate [ENVIRONMENT_NAME]
   conda install -c ctlearn-project dl1_data_handler=$DL1DH_VER

This should automatically install all dependencies (NOTE: this may take some time, as by default MKL is included as a dependency of NumPy and it is very large).


Links
-----


* `Cherenkov Telescope Array Observatory (CTAO) `_ - Homepage of the CTA Observatory
* `CTLearn `_ and `GammaLearn `_ - Repository of code for studies on applying deep learning to IACT analysis tasks. Maintained by groups at Universidad Complutense de Madrid, University of Geneva (CTLearn) and LAPP (GammaLearn).
* `ctapipe `_ - Official documentation for the ctapipe analysis package (in development)

Owner

  • Name: Cherenkov Telescope Array Consortium
  • Login: cta-observatory
  • Kind: organization

open-source software for the CTA Consortium.

GitHub Events

Total
  • Create event: 22
  • Release event: 5
  • Issues event: 13
  • Watch event: 2
  • Delete event: 23
  • Member event: 1
  • Issue comment event: 21
  • Push event: 112
  • Pull request event: 24
  • Pull request review event: 41
  • Pull request review comment event: 31
Last Year
  • Create event: 22
  • Release event: 5
  • Issues event: 13
  • Watch event: 2
  • Delete event: 23
  • Member event: 1
  • Issue comment event: 21
  • Push event: 112
  • Pull request event: 24
  • Pull request review event: 41
  • Pull request review comment event: 31

Committers

Last synced: about 3 years ago

All Time
  • Total Commits: 628
  • Total Committers: 19
  • Avg Commits per committer: 33.053
  • Development Distribution Score (DDS): 0.718
Top Committers
Name Email Commits
TjarkMiener t****2@g****m 177
bryankim96 b****m@g****m 169
Bryan Kim b****3@c****u 103
Luca Romanato l****1@c****t 42
Ari Brill a****l@g****m 31
Sahil Yadav 5****7@u****m 30
nieto@talos n****o@g****s 28
vuillaut t****e@g****m 16
Jarred Green a****d@g****m 8
mikael m****t@l****r 8
Daniel Nieto n****o@t****u 3
Daniel Nieto n****n@u****m 3
Thomas Vuillaume t****e@l****r 2
Tjark Miener i****1@l****r 2
Daniel Nieto d****o@u****s 2
Tjark Miener i****1@l****r 1
Luca Romanato 3****o@u****m 1
legutier l****r@a****l 1
Bryan Kim b****3 1
Committer Domains (Top 20 + Academic)
lapp.in2p3.fr: 2 alumnos.inf.utfsm.cl: 1 login-q-3.data.cluster: 1 ucm.es: 1 login-q-4.data.cluster: 1 tehanu.nevis.columbia.edu: 1 gae.ucm.es: 1 campus.unimib.it: 1 columbia.edu: 1

Issues and Pull Requests

Last synced: 7 months ago

All Time
  • Total issues: 58
  • Total pull requests: 100
  • Average time to close issues: 10 months
  • Average time to close pull requests: 29 days
  • Total issue authors: 15
  • Total pull request authors: 13
  • Average comments per issue: 3.02
  • Average comments per pull request: 1.36
  • Merged pull requests: 89
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 8
  • Pull requests: 27
  • Average time to close issues: 6 days
  • Average time to close pull requests: 15 days
  • Issue authors: 4
  • Pull request authors: 5
  • Average comments per issue: 0.5
  • Average comments per pull request: 1.04
  • Merged pull requests: 22
  • Bot issues: 0
  • Bot pull requests: 0
View more stats
Top Authors
Issue Authors
  • TjarkMiener (12)
  • aribrill (11)
  • mikael10j (10)
  • vuillaut (6)
  • nietootein (4)
  • mexanick (3)
  • jonpsy (2)
  • bryankim96 (2)
  • kosack (2)
  • BastienLacave (2)
  • qi-feng (1)
  • mrektor (1)
  • Adilet33709 (1)
  • riwim (1)
  • maxnoe (1)
Pull Request Authors
  • TjarkMiener (64)
  • rcervinoucm (16)
  • bryankim96 (7)
  • aribrill (6)
  • vuillaut (5)
  • mikael10j (4)
  • Pablitinho (4)
  • nietootein (2)
  • LucaRomanato (2)
  • sahilyadav27 (2)
  • kbruegge (1)
  • astrojarred (1)
  • jbuces (1)
Top Labels
Issue Labels
enhancement (17) bug (8) help wanted (6) ctapipe (4) support (2) question (2) discussion (2) dependencies (2) pytorch (1) software school (1) aitrigger (1)
Pull Request Labels
ready for review (28) enhancement (17) bug (15) ctapipe (13) dependencies (9) aitrigger (5) urgent (2) discussion (2) support (1) software school (1)

Packages

  • Total packages: 3
  • Total downloads:
    • pypi 191 last-month
  • Total dependent packages: 1
    (may contain duplicates)
  • Total dependent repositories: 3
    (may contain duplicates)
  • Total versions: 22
  • Total maintainers: 2
pypi.org: dl1-data-handler

A package of utilities for reading, and applying image processing to Cherenkov Telescope Array (CTA) R1/DL0/DL1 data in a standardized format. Created primarily for testing machine learning image analysis techniques on IACT data.

  • Versions: 20
  • Dependent Packages: 1
  • Dependent Repositories: 1
  • Downloads: 176 Last month
Rankings
Dependent packages count: 4.8%
Forks count: 9.3%
Stargazers count: 16.6%
Average: 18.5%
Dependent repos count: 21.6%
Downloads: 40.2%
Maintainers (1)
tmiener
Last synced: 8 months ago
pypi.org: dl1dh-test

dl1 HDF5 data writer + reader + processor

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 7 Last month
Rankings
Forks count: 9.3%
Dependent packages count: 10.1%
Stargazers count: 16.6%
Dependent repos count: 21.6%
Average: 27.7%
Downloads: 81.2%
Maintainers (1)
vuillaut
Last synced: 8 months ago
pypi.org: dl1-data-handler-light

light version of the dl1 HDF5 data writer + reader + processor

  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 8 Last month
Rankings
Forks count: 9.3%
Dependent packages count: 10.1%
Stargazers count: 16.6%
Dependent repos count: 21.6%
Average: 28.6%
Downloads: 85.4%
Maintainers (1)
vuillaut
Last synced: 8 months ago

Dependencies

setup.py pypi
  • astropy *
  • ctapipe ==0.15.0
  • jupyter *
  • numpy >1.16
  • pandas *
  • pytest-cov *
  • tables *
  • traitlets >=5.0
environment.yml pypi
  • pydot *