pegainfer-project's tracked open-source repos, sorted by stars.
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2