Topic · distributed-inference

distributed-inference

Tracked open-source repos tagged distributed-inference, sorted by stars.

Repos

4

Total stars

17,366

Avg. stars

4,342

Share

0.00%

Topics that frequently appear alongside distributed-inference on the same repo.

Recent risers

Repos created in the last 90 days, tagged distributed-inference.

No new repos tagged with this topic in the last 90 days.

#1
flashinfer ↗@flashinfer-aiPython
FlashInfer: Kernel Library for LLM Serving
★ 6,321+38Star change over the last 7 days
#2
gpustack ↗@gpustackPython
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
★ 5,593+21Star change over the last 7 days
#3
llm-d ↗@llm-dShell
Achieve state of the art inference performance with modern accelerators on Kubernetes
★ 4,390+69Star change over the last 7 days
#4
sglang-omni ↗@sgl-projectPython
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
★ 1,118+130Star change over the last 7 days

← Back to topics