Data

Tools

Indexes

Applications

Experiments

Open Source Science

ddl

Distributed Dataloader for PyTorch

https://github.com/maximilian-tech/ddl

Science Score: 67.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • ✓
    CITATION.cff file
    Found CITATION.cff file
  • ✓
    codemeta.json file
    Found codemeta.json file
  • ✓
    .zenodo.json file
    Found .zenodo.json file
  • ✓
    DOI references
    Found 1 DOI reference(s) in README
  • ✓
    Academic publication links
    Links to: zenodo.org
  • ○
    Academic email domains
  • ○
    Institutional organization owner
  • ○
    JOSS paper metadata
  • ○
    Scientific vocabulary similarity
    Low similarity (1.7%) to scientific vocabulary
Last synced: 10 months ago · JSON representation ·

Repository

Distributed Dataloader for PyTorch

Basic Info
  • Host: GitHub
  • Owner: maximilian-tech
  • License: lgpl-2.1
  • Language: Python
  • Default Branch: main
  • Size: 119 KB
Statistics
  • Stars: 1
  • Watchers: 2
  • Forks: 0
  • Open Issues: 0
  • Releases: 1
Created over 2 years ago · Last pushed over 2 years ago
Metadata Files
Readme License Citation

README.md

DOI

Actively developed.

Distributed Dataloader for PyTorch

This repo contains a fast MPI-based Dataloader for PyTorch.

Owner

  • Name: Maximilian Sander
  • Login: maximilian-tech
  • Kind: user
  • Location: Dresden

Citation (CITATION.cff) 

# What is a CITATION.cff file?
# See https://citation-file-format.github.io/

cff-version: 1.2.0
title: Distributed Dataloader for PyTorch
message: >-
  If you use this software, please cite it using the
  metadata from this file.
type: software
authors:
  - given-names: Maximilian
    family-names: Sander
    email: maximilian.sander1@tu-dresden.de
    affiliation: TUD Dresden University of Technology
license: LGPL-2.1-only

GitHub Events

Total
Last Year

Dependencies

poetry.lock pypi
  • backpack-for-pytorch 1.6.0
  • certifi 2023.11.17
  • charset-normalizer 3.3.2
  • cleverdict 1.9.1
  • colorama 0.4.6
  • coverage 7.3.2
  • einops 0.7.0
  • exceptiongroup 1.2.0
  • filelock 3.13.1
  • fsspec 2023.10.0
  • idna 3.4
  • iniconfig 2.0.0
  • jinja2 3.1.2
  • markupsafe 2.1.3
  • mpi4py 3.1.5
  • mpmath 1.3.0
  • mypy 1.7.0
  • mypy-extensions 1.0.0
  • networkx 3.2.1
  • numpy 1.26.2
  • packaging 23.2
  • pillow 10.1.0
  • pluggy 1.3.0
  • pytest 7.4.3
  • pytest-cov 4.1.0
  • pytest-timeout 2.2.0
  • pytorch-triton-rocm 2.1.0
  • requests 2.31.0
  • ruff 0.1.6
  • sympy 1.12
  • tomli 2.0.1
  • torch 2.1.0+rocm5.6
  • torchvision 0.16.0
  • typing-extensions 4.8.0
  • unfoldnd 0.2.0
  • urllib3 2.1.0
pyproject.toml pypi