Liuhong99's tracked open-source repos, sorted by stars.
The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
