llm-d's tracked open-source repos, sorted by stars.
Achieve state of the art inference performance with modern accelerators on Kubernetes