Updated 9 months ago
pytorch_optimizer
optimizer & lr scheduler & loss function collections in PyTorch
Updated 9 months ago
nadir
Nadir: Cutting-edge PyTorch optimizers for simplicity & composability! 🔥🚀💻
Updated 9 months ago
https://github.com/cedrickchee/ranger-optimizer
Ranger - a synergistic optimizer using RAdam (Rectified Adam) and Lookahead in one codebase