Topic · tokenspeed
tokenspeed
Tracked open-source repos tagged tokenspeed, sorted by stars.
Repos
3
Total stars
9,047
Avg. stars
3,016
Share
0.00%
Related topics
Topics that frequently appear alongside tokenspeed on the same repo.
Recent risers
Repos created in the last 90 days, tagged tokenspeed.
No new repos tagged with this topic in the last 90 days.
- #1
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
★ 6,470+40Star change over the last 7 days - #2
TokenSpeed is a speed-of-light LLM inference engine.
★ 2,075+44Star change over the last 7 days - #3
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
★ 510—Star change over the last 7 days
