LLMServe's tracked open-source repos, sorted by stars.
Disaggregated serving system for Large Language Models (LLMs).