JonasGeiping's tracked open-source repos, sorted by stars.
Cramming the training of a (BERT-type) language model into limited compute.