vllm-project/semantic-router

A programmable Mixture-of-Models router for heterogeneous LLM inference

↗ Open on GitHub

Stars

5,506

Forks

892

Language

Go

License

Apache-2.0

Last push

1 week ago

Go llm kubernetes vllm transformer pytorch inference ai-gateway guardrails llmrouter mixture-of-models semantic-router

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.