patchy631/time-to-first-token

A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.

↗ Open on GitHub

Stars

880

Forks

103

Language

HTML

License

Apache-2.0

Last push

3 weeks ago

HTML llm llm-inference vllm mlops roadmap learning-resources sglang

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.