Helldez/BigMoeOnEdge

Run MoE models bigger than your RAM. Frontier-size MoE on a 12 GB phone, CPU only, lossless, on stock llama.cpp

↗ Open on GitHub

Stars

550

Forks

58

Language

C++

License

Apache-2.0

Last push

3 days ago

C++android cpp llm on-device-ai qwen inference mixture-of-experts gguf llama-cpp edge-ai gemma moe gpt-oss

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.