thu-pacman's tracked open-source repos, sorted by stars.
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
