lsdb
LSDB - python tool for scalable analysis of large catalogs
Science Score: 67.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
✓DOI references
Found 2 DOI reference(s) in README -
✓Academic publication links
Links to: zenodo.org -
○Academic email domains
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (15.3%) to scientific vocabulary
Last synced: 6 months ago
·
JSON representation
·
Repository
LSDB - python tool for scalable analysis of large catalogs
Basic Info
- Host: GitHub
- Owner: astronomy-commons
- License: bsd-3-clause
- Language: Python
- Default Branch: main
- Homepage: https://lsdb.io
- Size: 45.6 MB
Statistics
- Stars: 37
- Watchers: 6
- Forks: 7
- Open Issues: 121
- Releases: 0
Created about 3 years ago
· Last pushed 6 months ago
Metadata Files
Readme
License
Citation
README.md
LSDB
LSDB
LSDB is a python tool for scalable analysis of large catalogs (i.e. querying and crossmatching ~10⁹ sources). This package uses dask to parallelize operations across multiple HATS partitioned surveys.
Check out our ReadTheDocs site for more information on partitioning, installation, and contributing.
See related projects:
- HATS (on GitHub) (on ReadTheDocs)
- HATS Import (on GitHub) (on ReadTheDocs)
Contributing
See the contribution guide for complete installation instructions and contribution best practices.
Citation
If you use LSDB in your work, please cite the conference proceedings: "Using LSDB to enable large-scale catalog distribution, cross-matching, and analytics".
If you use Rubin Data Preview 1 (DP1) with LSDB, please also cite: "Variability-finding in Rubin Data Preview 1 with LSDB".
Find full citation information here.
Acknowledgements
This project is supported by Schmidt Sciences.
This project is based upon work supported by the National Science Foundation under Grant No. AST-2003196.
This project acknowledges support from the DIRAC Institute in the Department of Astronomy at the University of Washington. The DIRAC Institute is supported through generous gifts from the Charles and Lisa Simonyi Fund for Arts and Sciences, and the Washington Research Foundation.
Owner
- Name: Astronomy Data Commons
- Login: astronomy-commons
- Kind: organization
- Repositories: 13
- Profile: https://github.com/astronomy-commons
Software Infrastructure for Science Platforms and Scalable Astronomy on Cloud Resources
Citation (CITATION.bib)
@ARTICLE{2025arXiv250102103C,
author = {{Caplar}, Neven and {Beebe}, Wilson and {Branton}, Doug and {Campos}, Sandro and {Connolly}, Andrew and {DeLucchi}, Melissa and {Jones}, Derek and {Juric}, Mario and {Kubica}, Jeremy and {Malanchev}, Konstantin and {Mandelbaum}, Rachel and {McGuire}, Sean},
title = "{Using LSDB to enable large-scale catalog distribution, cross-matching, and analytics}",
journal = {arXiv e-prints},
keywords = {Astrophysics - Instrumentation and Methods for Astrophysics},
year = 2025,
month = jan,
eid = {arXiv:2501.02103},
pages = {arXiv:2501.02103},
doi = {10.48550/arXiv.2501.02103},
archivePrefix = {arXiv},
eprint = {2501.02103},
primaryClass = {astro-ph.IM},
adsurl = {https://ui.adsabs.harvard.edu/abs/2025arXiv250102103C},
adsnote = {Provided by the SAO/NASA Astrophysics Data System}
}
@ARTICLE{2025arXiv250623955M,
author = {{Malanchev}, Konstantin and {DeLucchi}, Melissa and {Caplar}, Neven and {Malz}, Alex I. and {Beebe}, Wilson and {Branton}, Doug and {Campos}, Sandro and {Connolly}, Andrew and {Dai}, Mi and {Kubica}, Jeremy and {Lynn}, Olivia and {Mandelbaum}, Rachel and {McGuire}, Sean and {Aubourg}, Eric and {Blum}, Robert David and {Carlin}, Jeffrey L. and {Delgado}, Francisco and {Gangler}, Emmanuel and {Jannuzi}, Buell T. and {Jenness}, Tim and {Kang}, Yijung and {Kannawadi}, Arun and {Moniez}, Marc and {Plazas Malag{\'o}n}, Andr{\'e}s A. and {van Reeven}, Wouter and {Sanmartim}, David and {Urbach}, Elana K. and {Wood-Vasey}, W.~M.},
title = "{Variability-finding in Rubin Data Preview 1 with LSDB}",
journal = {arXiv e-prints},
keywords = {Instrumentation and Methods for Astrophysics, Solar and Stellar Astrophysics},
year = 2025,
month = jun,
eid = {arXiv:2506.23955},
pages = {arXiv:2506.23955},
doi = {10.48550/arXiv.2506.23955},
archivePrefix = {arXiv},
eprint = {2506.23955},
primaryClass = {astro-ph.IM},
adsurl = {https://ui.adsabs.harvard.edu/abs/2025arXiv250623955M},
adsnote = {Provided by the SAO/NASA Astrophysics Data System}
}
Issues and Pull Requests
Last synced: 6 months ago
All Time
- Total issues: 406
- Total pull requests: 377
- Average time to close issues: about 1 month
- Average time to close pull requests: 4 days
- Total issue authors: 22
- Total pull request authors: 18
- Average comments per issue: 0.75
- Average comments per pull request: 1.74
- Merged pull requests: 276
- Bot issues: 0
- Bot pull requests: 18
Past Year
- Issues: 257
- Pull requests: 224
- Average time to close issues: 25 days
- Average time to close pull requests: 2 days
- Issue authors: 18
- Pull request authors: 17
- Average comments per issue: 0.75
- Average comments per pull request: 1.69
- Merged pull requests: 151
- Bot issues: 0
- Bot pull requests: 9
Top Authors
Issue Authors
- nevencaplar (112)
- hombit (74)
- delucchi-cmu (55)
- smcguire-cmu (48)
- gitosaurus (33)
- camposandro (32)
- OliviaLynn (19)
- dougbrn (17)
- bsipocz (3)
- mjuric (2)
- wilsonbb (2)
- lokizg (2)
- JoaoDPassos (2)
- jkrick (2)
- troyraen (2)
Pull Request Authors
- delucchi-cmu (115)
- camposandro (76)
- smcguire-cmu (70)
- hombit (30)
- gitosaurus (27)
- dependabot[bot] (21)
- dougbrn (15)
- nevencaplar (14)
- OliviaLynn (12)
- Schwarzam (4)
- clytieq (3)
- kesiavino (2)
- wilsonbb (2)
- troyraen (1)
- olivialynn (1)
Top Labels
Issue Labels
enhancement (91)
bug (72)
documentation (60)
good first issue (11)
interface (11)
dataset (8)
nested-pandas (6)
performance (4)
dependencies (2)
question (1)
Pull Request Labels
dependencies (20)
github_actions (13)
python (7)
documentation (4)
bug (3)
enhancement (1)
Packages
- Total packages: 1
-
Total downloads:
- pypi 2,910 last-month
- Total dependent packages: 1
- Total dependent repositories: 3
- Total versions: 38
- Total maintainers: 4
pypi.org: lsdb
Spatial analysis for extremely large astronomical catalogs using dask
- Documentation: https://lsdb.readthedocs.io/
- License: BSD 3-Clause License Copyright (c) 2024, LINCC Frameworks Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met: 1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer. 2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution. 3. Neither the name of the copyright holder nor the names of its contributors may be used to endorse or promote products derived from this software without specific prior written permission. THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
-
Latest release: 0.6.4
published 6 months ago
Rankings
Dependent repos count: 8.9%
Dependent packages count: 10.1%
Average: 31.8%
Downloads: 76.3%
Maintainers (4)
Last synced:
6 months ago
Dependencies
.github/workflows/build-documentation.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
.github/workflows/linting.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
.github/workflows/publish-to-pypi.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
- pypa/gh-action-pypi-publish 27b31702a0e7fc50959f5ad993c78deac1bdfc29 composite
.github/workflows/smoke-test.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
.github/workflows/testing-and-coverage.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
- codecov/codecov-action v3 composite
.github/workflows/type-checking.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
docs/requirements.txt
pypi
- sphinx ==6.1.3
- sphinx-autoapi ==2.0.1
- sphinx_rtd_theme ==1.2.0
pyproject.toml
pypi
- deprecated *
- ipykernel *
.github/workflows/asv-main.yml
actions
- JamesIves/github-pages-deploy-action v4 composite
- actions/cache v3 composite
- actions/checkout v3 composite
- actions/setup-python v4 composite
- mktcode/consecutive-workflow-action eb43c6b5852dd0e33efa797a1817196d06daa4b2 composite
.github/workflows/asv-nightly.yml
actions
- actions/cache v3 composite
- actions/checkout v3 composite
- actions/setup-python v4 composite
.github/workflows/asv-pr.yml
actions
- Tiryoh/gha-jobid-action v0 composite
- actions/cache v3 composite
- actions/checkout v3 composite
- actions/github-script v6 composite
- actions/setup-python v4 composite
.github/workflows/pre-commit-ci.yml
actions
- actions/checkout v3 composite
- actions/setup-python v4 composite
- pre-commit-ci/lite-action v1.0.1 composite
- pre-commit/action v3.0.0 composite
requirements.txt
pypi