Topic · inference-optimization
inference-optimization
Tracked open-source repos tagged inference-optimization, sorted by stars.
Repos
4
Total stars
4,917
Avg. stars
1,229
Share
0.00%
Related topics
Topics that frequently appear alongside inference-optimization on the same repo.
Recent risers
Repos created in the last 90 days, tagged inference-optimization.
- #1
Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
★ 221
- #1
High-efficiency floating-point neural network inference operators for mobile, server, and Web
★ 2,439+2Star change over the last 7 days - #2
Efficient Deep Learning Systems course materials
★ 1,031+2Star change over the last 7 days - #3
BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
★ 932+0Star change over the last 7 days - #4
Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
★ 518+2Star change over the last 7 days
