lucidrains/MEGABYTE-pytorch

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

↗ Open on GitHub

Stars

655

Forks

55

Language

Python

License

MIT

Last push

2 years ago

Python deep-learning artificial-intelligence attention-mechanisms transformers long-context learned-tokenization

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.