lsst-daf-butler

Data Access abstraction framework for the Rubin Observatory

https://github.com/lsst/daf_butler

Science Score: 67.0%

This score indicates how likely this project is to be science-related based on various indicators:

✓
CITATION.cff file
Found CITATION.cff file
✓
codemeta.json file
Found codemeta.json file
✓
.zenodo.json file
Found .zenodo.json file
✓
DOI references
Found 4 DOI reference(s) in README
✓
Academic publication links
Links to: arxiv.org
○
Academic email domains
○
Institutional organization owner
○
JOSS paper metadata
○
Scientific vocabulary similarity
Low similarity (8.2%) to scientific vocabulary

Keywords

astronomy hacktoberfest python

Last synced: 6 months ago · JSON representation ·

Repository

Data Access abstraction framework for the Rubin Observatory

Basic Info

Host: GitHub
Owner: lsst
License: other
Language: Python
Default Branch: main
Homepage:
Size: 18 MB

Statistics

Stars: 13
Watchers: 12
Forks: 16
Open Issues: 12
Releases: 0

Topics

astronomy hacktoberfest python

Created over 8 years ago · Last pushed 6 months ago

Metadata Files

Readme License Citation Copyright

lsst-daf-butler

LSST Data Access framework described in arXiv:2206.14941. Please cite the SPIE paper when using this software.

This is a Python 3 only package (we assume Python 3.11 or higher).

SPIE Paper from 2022: The Vera C. Rubin Observatory Data Butler and Pipeline Execution System (arXiv)
ADASS paper from 2019: Abstracting the Storage and Retrieval of Image Data at the LSST.
Early design note: DMTN-056

PyPI: lsst-daf-butler

This software is dual licensed under the GNU General Public License (version 3 of the License, or (at your option) any later version, and also under a 3-clause BSD license). Recipients may choose which of these licenses to use; please see the files gpl-3.0.txt and/or bsd_license.txt, respectively.

Owner

Name: lsst
Login: lsst
Kind: organization
Location: Tucson, AZ

Website: http://lsst.org
Repositories: 233
Profile: https://github.com/lsst

Vera C. Rubin Observatory: preparing for the Legacy Survey of Space and Time

Citation (CITATION.cff)

cff-version: 1.2.0
message: "Please cite the following when using this software: https://doi.org/10.1117/12.2629569"
authors:
- name: "Rubin Observatory Data Management Team"
- family-names: Jenness
  given-names: Tim
  orcid: "https://orcid.org/0000-0001-5982-167X"
- family-names: Bosch
  given-names: James F.
  orcid: "https://orcid.org/0000-0003-2759-5764"
- family-names: Salnikov
  given-names: Andrei
  orcid: "https://orcid.org/0000-0002-3623-0161"
- family-names: Lust
  given-names: Nate B.
  orcid: "https://orcid.org/0000-0002-4122-9384"
- family-names: Pease
  given-names: Nathan M.
  orcid: "https://orcid.org/0000-0002-9701-5975"
- family-names: Gower
  given-names: Michelle
  orcid: "https://orcid.org/0000-0001-9513-6987"
- family-names: Kowalik
  given-names: Mikolaj
  orcid: "https://orcid.org/0000-0002-9801-5969"
- family-names: Schellart
  given-names: Pim
  orcid: "https://orcid.org/0000-0002-8324-0880"
- family-names: Irving
  given-names: David H.
  orcid: "https://orcid.org/0009-0005-9099-4970"
title: "lsst-daf-butler: Abstracted Data Access of Astronomical Data"
repository-code: "https://github.com/lsst/daf_butler"
identifiers:
- type: swh
  value: "swh:1:dir:ef572b4bb431e898d279d4de786bc462bd5ca466"
abstract: |
  The Rubin Observatory's Data Butler is designed to allow data file location
  and file formats to be abstracted away from the people writing the science
  pipeline algorithms. The Butler works in conjunction with the workflow graph
  builder to allow pipelines to be constructed from the algorithmic tasks.
preferred-citation:
  type: article
  title: "The Vera C. Rubin Observatory Data Butler and pipeline execution system"
  identifiers:
  - type: "doi"
    value: "10.1117/12.2629569"
  - type: "bibcode"
    value: "2022SPIE12189E..11J"
  authors:
  - family-names: Jenness
    given-names: Tim
    orcid: "https://orcid.org/0000-0001-5982-167X"
  - family-names: Bosch
    given-names: James F.
    orcid: "https://orcid.org/0000-0003-2759-5764"
  - family-names: Salnikov
    given-names: Andrei
    orcid: "https://orcid.org/0000-0002-3623-0161"
  - family-names: Lust
    given-names: Nate B.
    orcid: "https://orcid.org/0000-0002-4122-9384"
  - family-names: Pease
    given-names: Nathan M.
    orcid: "https://orcid.org/0000-0002-9701-5975"
  - family-names: Gower
    given-names: Michelle
    orcid: "https://orcid.org/0000-0001-9513-6987"
  - family-names: Kowalik
    given-names: Mikolaj
  - family-names: Dubois-Felsmann
    given-names: Gregory P.
    orcid: "https://orcid.org/0000-0003-1598-6979"
  - family-names: Mueller
    given-names: Fritz
    orcid: "https://orcid.org/0000-0002-7061-4644"
  - family-names: Schellart
    given-names: Pim
    orcid: "https://orcid.org/0000-0002-8324-0880"

GitHub Events

Total

Create event: 200
Commit comment event: 3
Issues event: 1
Watch event: 1
Delete event: 123
Issue comment event: 174
Push event: 724
Pull request review event: 312
Pull request review comment event: 248
Pull request event: 256
Fork event: 2

Last Year

Create event: 200
Commit comment event: 3
Issues event: 1
Watch event: 1
Delete event: 123
Issue comment event: 174
Push event: 724
Pull request review event: 312
Pull request review comment event: 248
Pull request event: 256
Fork event: 2

Issues and Pull Requests

Last synced: 6 months ago

All Time

Total issues: 9
Total pull requests: 792
Average time to close issues: 2 months
Average time to close pull requests: 12 days
Total issue authors: 4
Total pull request authors: 33
Average comments per issue: 0.89
Average comments per pull request: 1.24
Merged pull requests: 689
Bot issues: 0
Bot pull requests: 11

Past Year

Issues: 4
Pull requests: 311
Average time to close issues: 4 days
Average time to close pull requests: 6 days
Issue authors: 2
Pull request authors: 15
Average comments per issue: 0.75
Average comments per pull request: 1.19
Merged pull requests: 255
Bot issues: 0
Bot pull requests: 3

View more stats

Top Authors

Issue Authors

dhirving (6)
pllim (1)
ijiraq (1)
timj (1)

Pull Request Authors

timj (238)
dhirving (234)
TallJimbo (110)
andy-slac (77)
erykoff (28)
n8pease (18)
kfindeisen (13)
dependabot[bot] (11)
arunkannawadi (5)
mwittgen (4)
tgoldina (4)
parejkoj (4)
fred3m (4)
gpdf (4)
isullivan (4)

Top Labels

Issue Labels

Pull Request Labels

dependencies (11)

Packages

Total packages: 1
Total downloads:
- pypi 3,295 last-month

Total dependent packages: 5
Total dependent repositories: 8
Total versions: 212
Total maintainers: 1

pypi.org: lsst-daf-butler

An abstraction layer for reading and writing astronomical data to datastores.

Homepage: https://github.com/lsst/daf_butler
Documentation: https://lsst-daf-butler.readthedocs.io/
License: BSD 3-Clause License
Latest release: 29.2025.3600
published 6 months ago

Versions: 212
Dependent Packages: 5
Dependent Repositories: 8
Downloads: 3,295 Last month

Rankings

Dependent packages count: 1.6%

Dependent repos count: 5.2%

Downloads: 6.3%

Average: 8.5%

Forks count: 10.2%

Stargazers count: 19.4%

Maintainers (1)

rubinlsstdm

Last synced: 6 months ago

Dependencies

.github/workflows/build.yaml actions

actions/checkout v3 composite
actions/setup-python v4 composite
codecov/codecov-action v3 composite
conda-incubator/setup-miniconda v2 composite
pypa/gh-action-pypi-publish release/v1 composite

.github/workflows/build_docs.yaml actions

actions/checkout v3 composite
actions/setup-python v4 composite

.github/workflows/codeql-analysis.yml actions

actions/checkout v2 composite
github/codeql-action/analyze v2 composite
github/codeql-action/autobuild v2 composite
github/codeql-action/init v2 composite

.github/workflows/do_not_merge.yaml actions

actions/checkout v3 composite
gsactions/commit-message-checker v2 composite

.github/workflows/docstyle.yaml actions

.github/workflows/formatting.yaml actions

.github/workflows/lint.yaml actions

actions/checkout v3 composite
chartboost/ruff-action v1 composite

.github/workflows/mypy.yaml actions

.github/workflows/rebase_checker.yaml actions

.github/workflows/yamllint.yaml actions

pyproject.toml pypi

requirements.txt pypi

astropy >=4.0
backoff >=1.10
boto3 >=1.13
botocore >=1.15
click >7.0
deprecated >=1.2
fastapi *
httpx *
lsst-daf-relation main
lsst-resources main
lsst-sphgeom main
lsst-utils main
matplotlib >=3.0.3
moto >=1.3
numpy >=1.17
pandas >=1.0
pyarrow >=0.16
pydantic <3.0
pyyaml >=5.1
responses >=0.12.0
sqlalchemy >=1.4
urllib3 >=1.25.10

.github/workflows/docker.yaml actions

actions/checkout v3 composite
lsst-sqre/build-and-push-to-ghcr v1 composite

Dockerfile docker

base-image latest build
dependencies-image latest build
python 3.11.6-slim-bullseye build

requirements/docker-test.in pypi

pytest * test

requirements/docker-test.txt pypi

asn1crypto ==1.5.1 test
boto3 ==1.34.23 test
botocore ==1.34.23 test
certifi ==2023.11.17 test
cffi ==1.16.0 test
charset-normalizer ==3.3.2 test
contourpy ==1.2.0 test
cryptography ==41.0.7 test
cycler ==0.12.1 test
fonttools ==4.47.2 test
idna ==3.6 test
iniconfig ==2.0.0 test
jinja2 ==3.1.3 test
jmespath ==1.0.1 test
kiwisolver ==1.4.5 test
markupsafe ==2.1.4 test
matplotlib ==3.8.2 test
moto ==4.2.13 test
numpy ==1.26.3 test
packaging ==23.2 test
pg8000 ==1.30.4 test
pillow ==10.2.0 test
pluggy ==1.3.0 test
pycparser ==2.21 test
pyparsing ==3.1.1 test
pytest ==7.4.4 test
python-dateutil ==2.8.2 test
pyyaml ==6.0.1 test
requests ==2.31.0 test
responses ==0.24.1 test
s3transfer ==0.10.0 test
scramp ==1.4.4 test
six ==1.16.0 test
testing-common-database ==2.0.3 test
testing-postgresql ==1.3.0 test
urllib3 ==2.0.7 test
werkzeug ==3.0.1 test
xmltodict ==0.13.0 test

requirements/docker.in pypi

lsst-daf-relation *
lsst-resources *
lsst-sphgeom *
lsst-utils *
uvicorn *

requirements/docker.txt pypi

annotated-types ==0.6.0
anyio ==4.2.0
astropy ==6.0.0
astropy-iers-data ==0.2024.1.22.0.30.30
backoff ==2.2.1
boto3 ==1.34.23
botocore ==1.34.23
certifi ==2023.11.17
cffi ==1.16.0
charset-normalizer ==3.3.2
click ==8.1.7
cryptography ==41.0.7
defusedxml ==0.7.1
deprecated ==1.2.14
fastapi ==0.109.0
gidgethub ==5.3.0
greenlet ==3.0.3
h11 ==0.14.0
hpgeom ==1.2.0
httpcore ==1.0.2
httpx ==0.26.0
idna ==3.6
importlib-resources ==6.1.1
jinja2 ==3.1.3
jmespath ==1.0.1
lsst-daf-relation ==26.2024.300
lsst-resources ==26.2024.300
lsst-sphgeom ==26.2024.300
lsst-utils ==26.2024.300
markupsafe ==2.1.4
moto ==4.2.13
numpy ==1.26.3
packaging ==23.2
pandas ==2.2.0
psutil ==5.9.8
psycopg2 ==2.9.9
pyarrow ==15.0.0
pycparser ==2.21
pydantic ==2.5.3
pydantic-core ==2.14.6
pyerfa ==2.0.1.1
pyjwt ==2.8.0
python-dateutil ==2.8.2
pytz ==2023.3.post1
pyyaml ==6.0.1
requests ==2.31.0
responses ==0.24.1
s3transfer ==0.10.0
safir ==5.2.0
six ==1.16.0
sniffio ==1.3.0
sqlalchemy ==2.0.25
starlette ==0.35.1
structlog ==24.1.0
threadpoolctl ==3.2.0
typing-extensions ==4.9.0
tzdata ==2023.4
uritemplate ==4.1.1
urllib3 ==2.0.7
uvicorn ==0.26.0
werkzeug ==3.0.1
wrapt ==1.16.0
xmltodict ==0.13.0

requirements/main.in pypi

astropy >=5.2
click >7.0
deprecated >=1.2
fastapi *
httpx *
psycopg2 *
pyarrow >=0.16
pydantic >=2,<3.0
pyyaml >=5.1
safir >=3.4.0
sqlalchemy >=1.4

requirements/test.in pypi

matplotlib >=3.0.3 test
moto >=1.3 test
numpy >=1.17 test
pandas >=1.0 test
testing.postgresql * test

ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Open Source Science

lsst-daf-butler

Science Score: 67.0%

Keywords

Repository

Basic Info

Statistics

Topics

Metadata Files

README.md

lsst-daf-butler

Owner

Citation (CITATION.cff)

GitHub Events

Total

Last Year

Issues and Pull Requests

All Time

Past Year

Top Authors

Issue Authors

Pull Request Authors

Top Labels

Issue Labels

Pull Request Labels

Packages

pypi.org: lsst-daf-butler

Rankings

Maintainers (1)

Dependencies