dvmazur/mixtral-offloading

Run Mixtral-8x7B models in Colab or consumer desktops

↗ Open on GitHub

Stars

2,334

Forks

225

Language

Python

License

MIT

Last push

2 years ago

Python llm deep-learning language-model pytorch quantization mixture-of-experts colab-notebook google-colab offloading

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.