Mo, Z. LORO: Parameter and Memory Efficient Pretraining via Low-rank Riemannian Optimization (Version 1.0.0) [Computer software]. https://openreview.net/forum?id=i0zzO7Hslk