Topic · cpu-inference
cpu-inference
Tracked open-source repos tagged cpu-inference, sorted by stars.
Repos
3
Total stars
7,545
Avg. stars
2,515
Share
0.00%
Related topics
Topics that frequently appear alongside cpu-inference on the same repo.
Recent risers
Repos created in the last 90 days, tagged cpu-inference.
- #1
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
★ 7,164
- #1
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
★ 7,164+442Star change over the last 7 days - #2
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
★ 518+2Star change over the last 7 days - #3★ 510—Star change over the last 7 days
