Topic · high-performance-inference
high-performance-inference
Tracked open-source repos tagged high-performance-inference, sorted by stars.
Repos
2
Total stars
6,109
Avg. stars
3,055
Share
0.00%
Related topics
Topics that frequently appear alongside high-performance-inference on the same repo.
Recent risers
Repos created in the last 90 days, tagged high-performance-inference.
No new repos tagged with this topic in the last 90 days.
- #1
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
★ 5,593+21Star change over the last 7 days - #2
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
★ 518+2Star change over the last 7 days
