https://github.com/bytedance/flux • Rank 9.0 • Science 36%

A fast communication-overlapping library for tensor/expert parallelism on GPUs.