daf_butler
Science Score: 67.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
✓DOI references
Found 4 DOI reference(s) in README -
✓Academic publication links
Links to: arxiv.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (8.2%) to scientific vocabulary
Last synced: 6 months ago
·
JSON representation
·
Repository
Basic Info
- Host: GitHub
- Owner: lsst-dev-zy
- License: other
- Language: Python
- Default Branch: main
- Size: 13.4 MB
Statistics
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
- Releases: 0
Created about 1 year ago
· Last pushed about 1 year ago
Metadata Files
Readme
License
Citation
README.md
lsst-daf-butler
LSST Data Access framework described in arXiv:2206.14941. Please cite the SPIE paper when using this software.
This is a Python 3 only package (we assume Python 3.11 or higher).
- SPIE Paper from 2022: The Vera C. Rubin Observatory Data Butler and Pipeline Execution System (arXiv)
- ADASS paper from 2019: Abstracting the Storage and Retrieval of Image Data at the LSST.
- Early design note: DMTN-056
PyPI: lsst-daf-butler
This software is dual licensed under the GNU General Public License (version 3 of the License, or (at your option) any later version, and also under a 3-clause BSD license). Recipients may choose which of these licenses to use; please see the files gpl-3.0.txt and/or bsd_license.txt, respectively.
Owner
- Name: lsst-dev-zy
- Login: lsst-dev-zy
- Kind: organization
- Repositories: 1
- Profile: https://github.com/lsst-dev-zy
Citation (CITATION.cff)
cff-version: 1.2.0
message: "Please cite the following when using this software: https://doi.org/10.1117/12.2629569"
authors:
- name: "Rubin Observatory Data Management Team"
- family-names: Jenness
given-names: Tim
orcid: "https://orcid.org/0000-0001-5982-167X"
- family-names: Bosch
given-names: James F.
orcid: "https://orcid.org/0000-0003-2759-5764"
- family-names: Salnikov
given-names: Andrei
orcid: "https://orcid.org/0000-0002-3623-0161"
- family-names: Lust
given-names: Nate B.
orcid: "https://orcid.org/0000-0002-4122-9384"
- family-names: Pease
given-names: Nathan M.
orcid: "https://orcid.org/0000-0002-9701-5975"
- family-names: Gower
given-names: Michelle
orcid: "https://orcid.org/0000-0001-9513-6987"
- family-names: Kowalik
given-names: Mikolaj
orcid: "https://orcid.org/0000-0002-9801-5969"
- family-names: Schellart
given-names: Pim
orcid: "https://orcid.org/0000-0002-8324-0880"
- family-names: Irving
given-names: David H.
orcid: "https://orcid.org/0009-0005-9099-4970"
title: "lsst-daf-butler: Abstracted Data Access of Astronomical Data"
repository-code: "https://github.com/lsst/daf_butler"
identifiers:
- type: swh
value: "swh:1:dir:ef572b4bb431e898d279d4de786bc462bd5ca466"
abstract: |
The Rubin Observatory's Data Butler is designed to allow data file location
and file formats to be abstracted away from the people writing the science
pipeline algorithms. The Butler works in conjunction with the workflow graph
builder to allow pipelines to be constructed from the algorithmic tasks.
preferred-citation:
type: article
title: "The Vera C. Rubin Observatory Data Butler and pipeline execution system"
identifiers:
- type: "doi"
value: "10.1117/12.2629569"
- type: "bibcode"
value: "2022SPIE12189E..11J"
authors:
- family-names: Jenness
given-names: Tim
orcid: "https://orcid.org/0000-0001-5982-167X"
- family-names: Bosch
given-names: James F.
orcid: "https://orcid.org/0000-0003-2759-5764"
- family-names: Salnikov
given-names: Andrei
orcid: "https://orcid.org/0000-0002-3623-0161"
- family-names: Lust
given-names: Nate B.
orcid: "https://orcid.org/0000-0002-4122-9384"
- family-names: Pease
given-names: Nathan M.
orcid: "https://orcid.org/0000-0002-9701-5975"
- family-names: Gower
given-names: Michelle
orcid: "https://orcid.org/0000-0001-9513-6987"
- family-names: Kowalik
given-names: Mikolaj
- family-names: Dubois-Felsmann
given-names: Gregory P.
orcid: "https://orcid.org/0000-0003-1598-6979"
- family-names: Mueller
given-names: Fritz
orcid: "https://orcid.org/0000-0002-7061-4644"
- family-names: Schellart
given-names: Pim
orcid: "https://orcid.org/0000-0002-8324-0880"
GitHub Events
Total
- Push event: 4
- Create event: 2
Last Year
- Push event: 4
- Create event: 2
Dependencies
.github/workflows/build.yaml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- codecov/codecov-action v4 composite
- codecov/test-results-action v1 composite
- conda-incubator/setup-miniconda v3 composite
- pypa/gh-action-pypi-publish release/v1 composite
.github/workflows/build_docs.yaml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/codeql-analysis.yml
actions
- actions/checkout v4 composite
- github/codeql-action/analyze v3 composite
- github/codeql-action/autobuild v3 composite
- github/codeql-action/init v3 composite
.github/workflows/do_not_merge.yaml
actions
- actions/checkout v4 composite
- gsactions/commit-message-checker v2 composite
.github/workflows/docker.yaml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
- docker/build-push-action v5 composite
- lsst-sqre/build-and-push-to-ghcr v1 composite
.github/workflows/docstyle.yaml
actions
- actions/checkout v4 composite
- actions/setup-python v5 composite
.github/workflows/formatting.yaml
actions
.github/workflows/lint.yaml
actions
- actions/checkout v4 composite
- chartboost/ruff-action v1 composite
.github/workflows/mypy.yaml
actions
.github/workflows/rebase_checker.yaml
actions
.github/workflows/yamllint.yaml
actions
Dockerfile
docker
- base-image latest build
- dependencies-image latest build
- python 3.12.1-slim-bookworm build
- test-dependencies-image latest build
pyproject.toml
pypi
requirements/docker-test.in
pypi
- pytest * test
requirements/docker-test.txt
pypi
- asn1crypto ==1.5.1 test
- boto3 ==1.35.52 test
- botocore ==1.35.52 test
- certifi ==2024.8.30 test
- cffi ==1.17.1 test
- charset-normalizer ==3.4.0 test
- contourpy ==1.3.0 test
- cryptography ==43.0.3 test
- cycler ==0.12.1 test
- fonttools ==4.54.1 test
- idna ==3.10 test
- iniconfig ==2.0.0 test
- jinja2 ==3.1.4 test
- jmespath ==1.0.1 test
- kiwisolver ==1.4.7 test
- markupsafe ==3.0.2 test
- matplotlib ==3.9.2 test
- moto ==5.0.18 test
- numpy ==1.26.4 test
- packaging ==24.1 test
- pandas ==2.2.3 test
- pg8000 ==1.31.2 test
- pillow ==11.0.0 test
- pluggy ==1.5.0 test
- pycparser ==2.22 test
- pyparsing ==3.2.0 test
- pytest ==8.3.3 test
- python-dateutil ==2.9.0.post0 test
- pytz ==2024.2 test
- pyyaml ==6.0.2 test
- requests ==2.32.3 test
- responses ==0.25.3 test
- s3transfer ==0.10.3 test
- scramp ==1.4.5 test
- six ==1.16.0 test
- testing-common-database ==2.0.3 test
- testing-postgresql ==1.3.0 test
- tzdata ==2024.2 test
- urllib3 ==2.2.3 test
- werkzeug ==3.0.6 test
- xmltodict ==0.14.2 test
requirements/docker.in
pypi
- lsst-daf-relation *
- lsst-resources *
- lsst-sphgeom *
- lsst-utils *
- uvicorn *
requirements/docker.txt
pypi
- aiofiles ==23.2.1
- aiokafka ==0.12.0
- annotated-types ==0.7.0
- anyio ==4.6.2.post1
- astropy ==6.1.4
- astropy-iers-data ==0.2024.10.28.0.34.7
- async-timeout ==5.0.0
- attrs ==24.2.0
- backoff ==2.2.1
- boto3 ==1.35.52
- botocore ==1.35.52
- casefy ==0.1.7
- certifi ==2024.8.30
- cffi ==1.17.1
- charset-normalizer ==3.4.0
- click ==8.1.7
- cryptography ==43.0.3
- dacite ==1.8.1
- dataclasses-avroschema ==0.64.2
- defusedxml ==0.7.1
- deprecated ==1.2.14
- fast-depends ==2.4.12
- fastapi ==0.115.4
- fastavro ==1.9.7
- faststream ==0.5.28
- gidgethub ==5.3.0
- h11 ==0.14.0
- hpgeom ==1.4.0
- httpcore ==1.0.6
- httpx ==0.27.2
- idna ==3.10
- inflection ==0.5.1
- jmespath ==1.0.1
- jsonschema ==4.23.0
- jsonschema-specifications ==2024.10.1
- lsst-daf-relation ==27.2024.4400
- lsst-resources ==27.2024.4400
- lsst-sphgeom ==27.2024.4400
- lsst-utils ==27.2024.4400
- numpy ==1.26.4
- packaging ==24.1
- psutil ==6.1.0
- psycopg2 ==2.9.10
- pyarrow ==18.0.0
- pycparser ==2.22
- pydantic ==2.9.2
- pydantic-core ==2.23.4
- pydantic-settings ==2.5.2
- pyerfa ==2.0.1.4
- pyjwt ==2.9.0
- python-dateutil ==2.9.0.post0
- python-dotenv ==1.0.1
- python-schema-registry-client ==2.6.0
- pyyaml ==6.0.2
- referencing ==0.35.1
- requests ==2.32.3
- rpds-py ==0.20.1
- s3transfer ==0.10.3
- safir ==6.5.1
- safir-logging ==6.5.1
- six ==1.16.0
- sniffio ==1.3.1
- sqlalchemy ==2.0.36
- starlette ==0.41.2
- structlog ==24.4.0
- threadpoolctl ==3.5.0
- typing-extensions ==4.12.2
- uritemplate ==4.1.1
- urllib3 ==2.2.3
- uvicorn ==0.32.0
- wrapt ==1.16.0
requirements/main.in
pypi
- astropy >=5.2
- click >7.0
- deprecated >=1.2
- fastapi *
- httpx *
- numpy <2
- psycopg2 *
- pyarrow >=0.16
- pydantic >=2,<3.0
- pyyaml >=5.1
- safir >=3.4.0
- sqlalchemy >=1.4
requirements/test.in
pypi
- matplotlib >=3.0.3 test
- moto >=1.3 test
- numpy >=1.17,<2 test
- pandas >=1.0 test
- testing.postgresql * test
requirements.txt
pypi