dask-hpcconfig
Science Score: 44.0%
This score indicates how likely this project is to be science-related based on various indicators:
-
✓CITATION.cff file
Found CITATION.cff file -
✓codemeta.json file
Found codemeta.json file -
✓.zenodo.json file
Found .zenodo.json file -
○DOI references
-
○Academic publication links
-
○Committers with academic emails
-
○Institutional organization owner
-
○JOSS paper metadata
-
○Scientific vocabulary similarity
Low similarity (4.8%) to scientific vocabulary
Repository
Basic Info
- Host: GitHub
- Owner: umr-lops
- License: apache-2.0
- Language: Python
- Default Branch: main
- Homepage: https://dask-hpcconfig.readthedocs.io
- Size: 80.1 KB
Statistics
- Stars: 7
- Watchers: 1
- Forks: 2
- Open Issues: 4
- Releases: 4
Metadata Files
README.md
dask-hpcconfig
To install, use
bash
python -m pip install git+https://github.com/umr-lops/dask-hpcconfig.git#egg=dask-hpcconfig
or clone the source:
bash
git clone https://github.com/umr-lops/dask-hpcconfig.git
cd dask-hpcconfig
and then install from there:
bash
python -m pip install .
or as "editable":
bash
python -m pip install -e .
Usage
python
import dask_hpcconfig
To list the available cluster definitions:
python
dask_hpcconfig.print_clusters()
or, as a mapping of name to type:
python
clusters = dask_hpcconfig.available_clusters()
To create a cluster, use:
python
cluster = dask_hpcconfig.cluster(name)
where name is the name of one of the available clusters.
To override any particular setting: For example on 'datarmor-local' to use only 7 workers for increasing memory size of each worker:
python
overrides = {"cluster.n_workers": 7}
cluster = dask_hpcconfig.cluster("datarmor-local", **overrides)
For example on 'datarmor' to use only 7 workers for increasing memory size of each worker, and use 49 workers (i.e. 7 mpi_1 nodes) :
python
overrides = {"cluster.cores": 7}
cluster = dask_hpcconfig.cluster("datarmor", **overrides)
cluster.scale(49)
cluster can then be used to create a Client:
```python from distributed import Client
client = Client(cluster) ```
Owner
- Name: LOPS Laboratory for Ocean Physics and Satellite remote sensing
- Login: umr-lops
- Kind: organization
- Location: Plouzané, France
- Website: http://www.umr-lops.fr
- Repositories: 7
- Profile: https://github.com/umr-lops
Laboratory for Ocean Physics and Satellite remote sensing, UMR6523, CNRS-Ifremer-IRD-UBO
Citation (CITATION.cff)
# This CITATION.cff file was generated with cffinit.
# Visit https://bit.ly/cffinit to generate yours today!
cff-version: 1.2.0
title: dask-hpcconfig
message: >-
If you use this software, please cite it using the
metadata from this file.
type: software
authors:
- given-names: Justus
family-names: Magin
orcid: "https://orcid.org/0000-0002-4254-8002"
affiliation: >-
Univ Brest, CNRS, Ifremer, IRD, Laboratoire
d'Océanographie Physique et Spatiale (LOPS), IUEM,
F29280, Plouzané, France
- given-names: Tina
family-names: Odaka
orcid: "https://orcid.org/0000-0002-1500-0156"
affiliation: >-
Univ Brest, CNRS, Ifremer, IRD, Laboratoire
d'Océanographie Physique et Spatiale (LOPS), IUEM,
F29280, Plouzané, France
identifiers:
- type: doi
value: 10.5281/zenodo.7736117
description: Zenodo DOI
repository-code: "https://github.com/umr-lops/dask-hpcconfig"
abstract: >-
'dask-hpcconfig' provides an easy interface for creating
dask cluster optimised for each HPC environment.
keywords:
- Dask
- HPC
license: Apache-2.0
version: 2023.03.0
date-released: "2023-03-14"
GitHub Events
Total
- Release event: 1
- Delete event: 10
- Issue comment event: 6
- Push event: 18
- Pull request event: 22
- Create event: 11
Last Year
- Release event: 1
- Delete event: 10
- Issue comment event: 6
- Push event: 18
- Pull request event: 22
- Create event: 11
Committers
Last synced: about 3 years ago
All Time
- Total Commits: 36
- Total Committers: 5
- Avg Commits per committer: 7.2
- Development Distribution Score (DDS): 0.611
Top Committers
| Name | Commits | |
|---|---|---|
| pre-commit-ci[bot] | 6****]@u****m | 14 |
| Justus Magin | k****s@u****m | 14 |
| Tina Odaka | 4****k@u****m | 6 |
| dependabot[bot] | 4****]@u****m | 1 |
| Keewis | k****s@p****e | 1 |
Committer Domains (Top 20 + Academic)
Issues and Pull Requests
Last synced: 7 months ago
All Time
- Total issues: 6
- Total pull requests: 76
- Average time to close issues: about 3 hours
- Average time to close pull requests: 22 days
- Total issue authors: 4
- Total pull request authors: 4
- Average comments per issue: 0.5
- Average comments per pull request: 0.11
- Merged pull requests: 61
- Bot issues: 0
- Bot pull requests: 45
Past Year
- Issues: 1
- Pull requests: 19
- Average time to close issues: N/A
- Average time to close pull requests: 20 days
- Issue authors: 1
- Pull request authors: 3
- Average comments per issue: 1.0
- Average comments per pull request: 0.11
- Merged pull requests: 14
- Bot issues: 0
- Bot pull requests: 14
Top Authors
Issue Authors
- tinaok (3)
- gmaze (1)
- keewis (1)
- oarcher (1)
Pull Request Authors
- pre-commit-ci[bot] (28)
- dependabot[bot] (19)
- keewis (19)
- tinaok (12)
Top Labels
Issue Labels
Pull Request Labels
Packages
- Total packages: 1
-
Total downloads:
- pypi 44 last-month
- Total dependent packages: 0
- Total dependent repositories: 1
- Total versions: 3
- Total maintainers: 2
pypi.org: dask-hpcconfig
Configuration for various dask clusters
- Documentation: https://dask-hpcconfig.readthedocs.io
- License: apache-2.0
-
Latest release: 2025.6.0
published 10 months ago
Rankings
Dependencies
- click <8.1
- dask *
- dask-jobqueue *
- distributed *
- ipython *
- pyyaml *
- rich *
- sphinx *
- sphinx-book-theme *
- sphinx-click *
- sphinx-copybutton *
- sphinx-panels *
- typer *
- actions/checkout v4 composite
- actions/setup-python v4 composite
- pypa/gh-action-pypi-publish 2f6f737ca5f74c637829c0f5c3acd0e29ea5e8bf composite