Topic · continuous-batching

continuous-batching

Tracked open-source repos tagged continuous-batching, sorted by stars.

Repos

1

Total stars

1,557

Avg. stars

1,557

Share

0.00%

Topics that frequently appear alongside continuous-batching on the same repo.

Recent risers

Repos created in the last 90 days, tagged continuous-batching.

No new repos tagged with this topic in the last 90 days.

#1
vllm-mlx ↗@waybarriosPython
High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
★ 1,557+0Star change over the last 7 days

← Back to topics