dask-cuda

Utilities for Dask and CUDA interactions

https://github.com/rapidsai/dask-cuda

Science Score: 36.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
    Found codemeta.json file
  • .zenodo.json file
    Found .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
    1 of 60 committers (1.7%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (5.6%) to scientific vocabulary

Keywords from Contributors

tensor xgboost gbrt gbm gbdt parallel-computing flexible alignment nvidia conda
Last synced: 6 months ago · JSON representation

Repository

Utilities for Dask and CUDA interactions

Basic Info
Statistics
  • Stars: 314
  • Watchers: 24
  • Forks: 102
  • Open Issues: 88
  • Releases: 40
Created about 7 years ago · Last pushed 6 months ago
Metadata Files
Readme Changelog License Codeowners

README.md

Dask CUDA

Various utilities to improve deployment and management of Dask workers on CUDA-enabled systems.

This library is experimental, and its API is subject to change at any time without notice.

Example

```python from dask_cuda import LocalCUDACluster from dask.distributed import Client

cluster = LocalCUDACluster() client = Client(cluster) ```

Documentation is available here.

What this is not

This library does not automatically convert your Dask code to run on GPUs.

It only helps with deployment and management of Dask workers in multi-GPU systems. Parallelizing GPU libraries like RAPIDS and CuPy with Dask is an ongoing effort. You may wish to read about this effort at blog.dask.org for more information. Additional information about Dask-CUDA can also be found in the docs.

Owner

  • Name: RAPIDS
  • Login: rapidsai
  • Kind: organization

Open GPU Data Science

GitHub Events

Total
  • Create event: 106
  • Release event: 9
  • Issues event: 25
  • Watch event: 21
  • Delete event: 96
  • Issue comment event: 276
  • Push event: 240
  • Pull request review comment event: 125
  • Pull request review event: 217
  • Pull request event: 206
  • Fork event: 9
Last Year
  • Create event: 106
  • Release event: 9
  • Issues event: 25
  • Watch event: 21
  • Delete event: 96
  • Issue comment event: 276
  • Push event: 240
  • Pull request review comment event: 125
  • Pull request review event: 217
  • Pull request event: 206
  • Fork event: 9

Committers

Last synced: 8 months ago

All Time
  • Total Commits: 1,093
  • Total Committers: 60
  • Avg Commits per committer: 18.217
  • Development Distribution Score (DDS): 0.656
Past Year
  • Commits: 113
  • Committers: 19
  • Avg Commits per committer: 5.947
  • Development Distribution Score (DDS): 0.77
Top Committers
Name Email Commits
Peter Andreas Entschev p****r@e****m 376
Mads R. B. Kristensen m****k@g****m 151
John Kirkham j****m@g****m 85
Raymond Douglass r****y@r****m 78
Benjamin Zaitlen q****n@g****m 60
GALI PREM SAGAR s****5@g****m 43
Charles Blackmon-Luca 2****a 30
AJ Schmidt a****8 26
James Lamb j****b@n****m 23
Bradley Dice b****e@b****m 22
Matthew Rocklin m****n@g****m 21
Lawrence Mitchell l****l@n****m 20
Richard (Rick) Zamora r****7@g****m 19
Jake Awe 5****e 12
Vyas Ramasubramani v****r@n****m 11
Jordan Jacobelli j****i@n****m 10
Gil Forsyth g****h 10
Jacob Tomlinson j****n 10
Kyle Edwards k****s@n****m 9
Tom Augspurger t****r@n****m 7
Dillon Cullinan d****2@g****m 6
Mark Sadang m****g@e****m 6
gpuCI 3****r 4
Ashwin Srinath 3****a 4
Dillon Cullinan d****n@d****m 4
Ajay Thorve A****e 3
Joseph 6****i 3
Eli Fajardo e****o@n****m 2
Jaya Venkatesh j****r@n****m 2
Rami Chowdhury r****y@g****m 2
and 30 more...

Issues and Pull Requests

Last synced: 6 months ago

All Time
  • Total issues: 83
  • Total pull requests: 538
  • Average time to close issues: 3 months
  • Average time to close pull requests: 17 days
  • Total issue authors: 43
  • Total pull request authors: 33
  • Average comments per issue: 2.8
  • Average comments per pull request: 1.99
  • Merged pull requests: 462
  • Bot issues: 0
  • Bot pull requests: 44
Past Year
  • Issues: 16
  • Pull requests: 242
  • Average time to close issues: 1 day
  • Average time to close pull requests: 3 days
  • Issue authors: 11
  • Pull request authors: 21
  • Average comments per issue: 0.81
  • Average comments per pull request: 1.6
  • Merged pull requests: 200
  • Bot issues: 0
  • Bot pull requests: 31
Top Authors
Issue Authors
  • pentschev (14)
  • jakirkham (8)
  • rjzamora (5)
  • randerzander (4)
  • trivialfis (4)
  • VibhuJawa (3)
  • madsbk (3)
  • jacobtomlinson (2)
  • ilan-gold (2)
  • ayushdg (2)
  • LUOXIAO92 (2)
  • kanglcn (2)
  • quasiben (2)
  • AquifersBSIM (1)
  • loretoparisi (1)
Pull Request Authors
  • pentschev (118)
  • jameslamb (49)
  • rapids-bot[bot] (44)
  • GPUtester (35)
  • bdice (34)
  • gforsyth (30)
  • rjzamora (29)
  • jakirkham (28)
  • raydouglass (22)
  • AyodeAwe (19)
  • KyleFromNVIDIA (18)
  • galipremsagar (16)
  • vyasr (15)
  • TomAugspurger (15)
  • wence- (12)
Top Labels
Issue Labels
bug (8) python (2) feature request (2) inactive-90d (2) inactive-30d (2) 0 - Blocked (1) doc (1) ? - Needs Triage (1) good first issue (1) 0 - Backlog (1) improvement (1) non-breaking (1) ci (1) question (1)
Pull Request Labels
non-breaking (394) improvement (246) python (175) 3 - Ready for Review (128) ci (123) conda (105) bug (105) feature request (48) breaking (19) 5 - Ready to Merge (18) gpuCI (15) 2 - In Progress (14) doc (13) 5 - DO NOT MERGE (8) 0 - Blocked (7) inactive-30d (3) ! - Hotfix (2) 5 - Merge After Dependencies (1) inactive-90d (1) 4 - Needs Reviewer (1)

Packages

  • Total packages: 24
  • Total downloads:
    • pypi 63,597 last-month
  • Total docker downloads: 11,240,610
  • Total dependent packages: 29
    (may contain duplicates)
  • Total dependent repositories: 429
    (may contain duplicates)
  • Total versions: 2,000
  • Total maintainers: 4
pypi.org: dask-cuda

Utilities for Dask and CUDA interactions

  • Versions: 1,968
  • Dependent Packages: 11
  • Dependent Repositories: 125
  • Downloads: 55,629 Last month
  • Docker Downloads: 1,177,993
Rankings
Docker downloads count: 0.8%
Dependent repos count: 1.3%
Downloads: 1.5%
Dependent packages count: 2.4%
Average: 2.5%
Stargazers count: 4.2%
Forks count: 4.9%
Maintainers (3)
Last synced: 7 months ago
pypi.org: cudf
  • Versions: 1
  • Dependent Packages: 9
  • Dependent Repositories: 82
  • Downloads: 3,563 Last month
  • Docker Downloads: 1,177,433
Rankings
Docker downloads count: 0.8%
Dependent packages count: 1.3%
Dependent repos count: 1.6%
Average: 3.2%
Stargazers count: 4.4%
Forks count: 5.0%
Downloads: 5.9%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cuml
  • Versions: 1
  • Dependent Packages: 6
  • Dependent Repositories: 37
  • Downloads: 2,494 Last month
  • Docker Downloads: 1,177,332
Rankings
Docker downloads count: 0.8%
Dependent packages count: 2.2%
Dependent repos count: 2.4%
Average: 3.5%
Stargazers count: 4.4%
Forks count: 5.0%
Downloads: 6.0%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cugraph
  • Versions: 1
  • Dependent Packages: 1
  • Dependent Repositories: 38
  • Downloads: 819 Last month
  • Docker Downloads: 1,177,332
Rankings
Docker downloads count: 0.8%
Dependent repos count: 2.4%
Dependent packages count: 3.3%
Stargazers count: 4.4%
Forks count: 5.0%
Average: 5.6%
Downloads: 18.0%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cusignal
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 17
  • Downloads: 125 Last month
  • Docker Downloads: 1,042,009
Rankings
Docker downloads count: 0.8%
Dependent repos count: 3.6%
Stargazers count: 4.4%
Forks count: 5.0%
Average: 7.3%
Dependent packages count: 7.4%
Downloads: 22.7%
Maintainers (1)
Last synced: 6 months ago
pypi.org: rmm
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 34
  • Downloads: 261 Last month
  • Docker Downloads: 1,177,433
Rankings
Docker downloads count: 0.8%
Dependent repos count: 2.5%
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 7.8%
Downloads: 26.5%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cudf-cuda100
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 2
  • Downloads: 42 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 9.6%
Dependent repos count: 11.9%
Downloads: 19.2%
Maintainers (1)
Last synced: 6 months ago
pypi.org: clx
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 8
  • Downloads: 98 Last month
  • Docker Downloads: 820
Rankings
Docker downloads count: 1.9%
Stargazers count: 4.4%
Forks count: 5.0%
Dependent repos count: 5.3%
Dependent packages count: 7.4%
Average: 10.3%
Downloads: 37.6%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cuxfilter
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 8
  • Downloads: 35 Last month
  • Docker Downloads: 1,054,576
Rankings
Docker downloads count: 0.8%
Stargazers count: 4.4%
Forks count: 5.0%
Dependent repos count: 5.3%
Dependent packages count: 7.4%
Average: 10.7%
Downloads: 41.2%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cuspatial
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 17
  • Downloads: 95 Last month
  • Docker Downloads: 1,054,576
Rankings
Docker downloads count: 0.8%
Dependent repos count: 3.6%
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 11.2%
Downloads: 46.0%
Maintainers (1)
Last synced: 6 months ago
pypi.org: rapids-xgboost
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 8
  • Downloads: 27 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent repos count: 5.3%
Dependent packages count: 7.4%
Average: 12.8%
Downloads: 42.1%
Maintainers (1)
Last synced: 6 months ago
pypi.org: rapidsai
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 111 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 13.2%
Dependent repos count: 22.3%
Downloads: 26.9%
Maintainers (1)
Last synced: 6 months ago
pypi.org: dask-cuml
  • Versions: 2
  • Dependent Packages: 0
  • Dependent Repositories: 2
  • Downloads: 29 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Dependent repos count: 11.9%
Average: 13.7%
Downloads: 39.6%
Maintainers (1)
Last synced: 6 months ago
pypi.org: ucx-py
  • Versions: 1
  • Dependent Packages: 1
  • Dependent Repositories: 14
  • Downloads: 94 Last month
  • Docker Downloads: 1,188,149
Rankings
Docker downloads count: 0.8%
Dependent repos count: 3.9%
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 13.7%
Downloads: 60.8%
Maintainers (2)
Last synced: 6 months ago
pypi.org: cuml-cuda100
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 18 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 14.1%
Dependent repos count: 22.3%
Downloads: 31.4%
Maintainers (1)
Last synced: 6 months ago
pypi.org: nvstrings-cuda100
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 2
  • Downloads: 27 Last month
  • Docker Downloads: 90
Rankings
Docker downloads count: 2.5%
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Dependent repos count: 11.9%
Average: 15.0%
Downloads: 58.6%
Maintainers (1)
Last synced: 6 months ago
pypi.org: custreamz
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 2
  • Downloads: 16 Last month
  • Docker Downloads: 1,012,867
Rankings
Docker downloads count: 0.8%
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Dependent repos count: 11.9%
Average: 15.0%
Downloads: 60.8%
Maintainers (1)
Last synced: 6 months ago
pypi.org: nvstrings-cuda92
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 8
  • Downloads: 24 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent repos count: 5.3%
Dependent packages count: 7.4%
Average: 18.5%
Downloads: 70.4%
Maintainers (1)
Last synced: 6 months ago
pypi.org: nvstrings
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 8
  • Downloads: 13 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent repos count: 5.3%
Dependent packages count: 7.4%
Average: 18.5%
Downloads: 70.4%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cuml-cuda92
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 16 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 18.8%
Dependent repos count: 22.3%
Downloads: 54.7%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cudf-cuda92
  • Versions: 1
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 25 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 18.8%
Dependent repos count: 22.3%
Downloads: 54.7%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cugraph-cuda92
  • Versions: 2
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 21 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 18.8%
Dependent repos count: 22.3%
Downloads: 54.7%
Maintainers (1)
Last synced: 6 months ago
pypi.org: cugraph-cuda100
  • Versions: 2
  • Dependent Packages: 0
  • Dependent Repositories: 1
  • Downloads: 15 Last month
Rankings
Stargazers count: 4.4%
Forks count: 5.0%
Dependent packages count: 7.4%
Average: 19.1%
Dependent repos count: 22.3%
Downloads: 56.6%
Maintainers (1)
Last synced: 6 months ago
conda-forge.org: dask-cuda
  • Versions: 7
  • Dependent Packages: 1
  • Dependent Repositories: 11
Rankings
Dependent repos count: 10.6%
Forks count: 21.1%
Average: 21.4%
Stargazers count: 25.0%
Dependent packages count: 28.9%
Last synced: 6 months ago

Dependencies

.github/workflows/build.yaml actions
  • actions/checkout v3 composite
  • pypa/gh-action-pypi-publish release/v1 composite
.github/workflows/labeler.yml actions
  • actions/labeler main composite
.github/workflows/pr.yaml actions
  • actions/checkout v3 composite
pyproject.toml pypi
  • dask ==2023.1.1
  • distributed ==2023.1.1
  • numba >=0.54
  • numpy >=1.18.0
  • pandas >=1.0
  • pynvml >=11.0.0
  • zict >=0.1.3
.github/workflows/test.yaml actions
setup.py pypi