https://github.com/cloneofsimo/mindiffusion

Self-contained, minimalistic implementation of diffusion models with Pytorch.

https://github.com/cloneofsimo/mindiffusion

Science Score: 10.0%

This score indicates how likely this project is to be science-related based on various indicators:

  • CITATION.cff file
  • codemeta.json file
  • .zenodo.json file
  • DOI references
  • Academic publication links
  • Committers with academic emails
    1 of 2 committers (50.0%) from academic institutions
  • Institutional organization owner
  • JOSS paper metadata
  • Scientific vocabulary similarity
    Low similarity (8.5%) to scientific vocabulary

Keywords

diffusion pytorch
Last synced: 5 months ago · JSON representation

Repository

Self-contained, minimalistic implementation of diffusion models with Pytorch.

Basic Info
  • Host: GitHub
  • Owner: cloneofsimo
  • Language: Python
  • Default Branch: master
  • Homepage:
  • Size: 3.51 MB
Statistics
  • Stars: 1,052
  • Watchers: 10
  • Forks: 133
  • Open Issues: 6
  • Releases: 0
Topics
diffusion pytorch
Created almost 4 years ago · Last pushed over 3 years ago
Metadata Files
Readme

README.md

minDiffusion

Goal of this educational repository is to provide a self-contained, minimalistic implementation of diffusion models using Pytorch.

Many implementations of diffusion models can be a bit overwhelming. Here, superminddpm : under 200 lines of code, fully self contained implementation of DDPM with Pytorch is a good starting point for anyone who wants to get started with Denoising Diffusion Models, without having to spend time on the details.

Simply:

$ python superminddpm.py

Above script is self-contained. (Of course, you need to have pytorch and torchvision installed. Latest version should suffice. We do not use any cutting edge features.)

If you want to use the bit more refactored code, that runs CIFAR10 dataset:

$ python train_cifar10.py

Above result took about 2 hours of training on single 3090 GPU. Top 8 images are generated, bottom 8 are ground truth.

Here is another example, trained on 100 epochs (about 1.5 hours)

Currently has:

  • [x] Tiny implementation of DDPM
  • [x] MNIST, CIFAR dataset.
  • [x] Simple unet structure. + Simple Time embeddings.
  • [x] CelebA dataset.

TODOS

  • [ ] DDIM
  • [ ] Classifier Guidance
  • [ ] Multimodality

Updates!

  • Using more parameter yields better result for MNIST.
  • More comments in superminddpm.py

Owner

  • Name: Simo Ryu
  • Login: cloneofsimo
  • Kind: user
  • Company: Corca AI

Cats are Turing machines cloneofsimo@gmail.com

GitHub Events

Total
  • Watch event: 215
  • Fork event: 25
Last Year
  • Watch event: 215
  • Fork event: 25

Committers

Last synced: 9 months ago

All Time
  • Total Commits: 16
  • Total Committers: 2
  • Avg Commits per committer: 8.0
  • Development Distribution Score (DDS): 0.063
Past Year
  • Commits: 0
  • Committers: 0
  • Avg Commits per committer: 0.0
  • Development Distribution Score (DDS): 0.0
Top Committers
Name Email Commits
Simo Ryu c****o@g****m 15
Yushan Xie 1****3@s****n 1
Committer Domains (Top 20 + Academic)

Issues and Pull Requests

Last synced: 9 months ago

All Time
  • Total issues: 7
  • Total pull requests: 2
  • Average time to close issues: 25 days
  • Average time to close pull requests: 3 days
  • Total issue authors: 6
  • Total pull request authors: 2
  • Average comments per issue: 1.0
  • Average comments per pull request: 0.5
  • Merged pull requests: 1
  • Bot issues: 0
  • Bot pull requests: 0
Past Year
  • Issues: 0
  • Pull requests: 0
  • Average time to close issues: N/A
  • Average time to close pull requests: N/A
  • Issue authors: 0
  • Pull request authors: 0
  • Average comments per issue: 0
  • Average comments per pull request: 0
  • Merged pull requests: 0
  • Bot issues: 0
  • Bot pull requests: 0
Top Authors
Issue Authors
  • LexiestLeszek (2)
  • tuxlimr (1)
  • stsavian (1)
  • fikry102 (1)
  • metamath1 (1)
  • jorgejgnz (1)
Pull Request Authors
  • DenDiv (1)
  • SilenceMonk (1)
Top Labels
Issue Labels
Pull Request Labels