smg-project/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

↗ 在 GitHub 打开

星数

517

Fork 数

160

语言

Rust

许可

Apache-2.0

最后推送

18小时前

Rust mcp openai routing llm anthropic claude vllm gemini chat anthropic-api sglang responses-api lightseek tokenspeed inference-gateway tensorrtllm trtllm

还没有相关情报

radar 追踪的来源里还没有出现过这个 repo。收集器按计划运行——等它覆盖到这个 repo 再回来看看。