instances
The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more
hivemind
Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.
tensorcircuit-ng
The next-gen tensor network based quantum software framework: superseding the original TensorCircuit
https://github.com/deeprec-ai/deeprec
DeepRec is a high-performance recommendation deep learning framework based on TensorFlow. It is hosted in incubation in LF AI & Data Foundation.
relora
Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
https://github.com/alpa-projects/alpa
Training and serving large-scale neural networks with auto parallelization.
https://github.com/bytedance/byteps
A high performance and generic framework for distributed DNN training
https://github.com/cornell-zhang/hoga
Hop-Wise Graph Attention for Scalable and Generalizable Learning on Circuits
https://github.com/awslabs/dynamic-training-with-apache-mxnet-on-aws
Dynamic training with Apache MXNet reduces cost and time for training deep neural networks by leveraging AWS cloud elasticity and scale. The system reduces training cost and time by dynamically updating the training cluster size during training, with minimal impact on model training accuracy.