rednote-machine-learning's tracked open-source repos, sorted by stars.
Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention
