bigscience-workshop/Megatron-DeepSpeed

@bigscience-workshop

Ongoing research training transformer language models at scale, including: BERT & GPT-2

↗ Open on GitHub

Stars

1,448

Forks

226

Language

Python

License

NOASSERTION

Last push

2 years ago

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.