Skip to main content
buildradar
Sign in
Topic · llm-gateway

llm-gateway

Tracked open-source repos tagged llm-gateway, sorted by stars.

Repos
17
Total stars
243,336
Avg. stars
14,314
Share
0.01%

Topics that frequently appear alongside llm-gateway on the same repo.

Recent risers

Repos created in the last 90 days, tagged llm-gateway.

  • paritok-4b-v1@Paritok-official

    Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3× more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.

    1,450
  • OmniRoute@diegosouzapw

    Never stop coding. Free MIT AI gateway: one endpoint, 352 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 550+ contributors

    60,442+2,385Star change over the last 7 days
  • litellm@BerriAI

    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

    57,875+325Star change over the last 7 days
  • kong@Kong

    🦍 The API and AI Gateway

    44,076+18Star change over the last 7 days
  • 9router@decolua

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

    26,947+317Star change over the last 7 days
  • gateway@Portkey-AI

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

    12,882+28Star change over the last 7 days
  • coai@coaidev

    🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.

    9,303+6Star change over the last 7 days
  • bifrost@maximhq

    Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

    7,763+118Star change over the last 7 days
  • plano@katanemo

    Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

    7,033+11Star change over the last 7 days
  • gpt-load@tbphp

    Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关:多渠道多凭据统一接入,含密钥与订阅账号、调度容错、日志与用量。

    6,478+191Star change over the last 7 days
  • octopus@bestruirui

    One Hub All LLMs For You | 为个人打造的 LLM API 聚合网关

    2,575+16Star change over the last 7 days
  • APIPark@APIParkLab

    Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.🦄云原生、超高性能 AI&API网关,LLM API 管理、分发系统、开放平台,支持所有AI API,不限于OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型,统一 API 请求和返回,API申请与审批,调用统计、负载均衡、多模型灾备。一键部署,开箱即用。

    1,807+3Star change over the last 7 days
  • llmgateway@theopenco

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    1,594+8Star change over the last 7 days
  • paritok-4b-v1@Paritok-official

    Non-destructive compression gateway for AI coding agents. Cuts token bills 25% on turn 1 to past 85% in long or saturated sessions, and fits ~3× more turns in the same context window. Powered by our open-source code-native 4B model. Drop-in for Claude Code, Cursor, Codex, OpenHands, and any BASE_URL agent.

    1,450+3Star change over the last 7 days
  • GoModel@ENTERPILOT

    AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

    1,114+18Star change over the last 7 days
  • vllora@vllora

    Debug your AI agents

    811-2Star change over the last 7 days
  • NadirClaw@NadirRouter

    Open-source LLM router & AI cost optimizer. Routes simple prompts to cheap/local models, complex ones to premium — automatically. Drop-in OpenAI-compatible proxy for Claude Code, Codex, Cursor, OpenClaw. Saves 40-70% on AI API costs. Self-hosted, no middleman.

    647+1Star change over the last 7 days
  • Lynkr@Fast-Editor

    Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

    547+2Star change over the last 7 days
← Back to topics