https://github.com/cedrickchee/ranger-optimizer • Science 10%

Ranger - a synergistic optimizer using RAdam (Rectified Adam) and Lookahead in one codebase