Topic · tensorrtllm
tensorrtllm
Tracked open-source repos tagged tensorrtllm, sorted by stars.
Repos
1
Total stars
502
Avg. stars
502
Share
0.00%
Related topics
Topics that frequently appear alongside tensorrtllm on the same repo.
Recent risers
Repos created in the last 90 days, tagged tensorrtllm.
No new repos tagged with this topic in the last 90 days.
- #1
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
★ 509—Star change over the last 7 days
