mosecorg's tracked open-source repos, sorted by stars.
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine