mosecorg/mosec

A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine

↗ Open on GitHub

Stars

902

Forks

73

Language

Python

License

Apache-2.0

Last push

1 day ago

Python rust python hacktoberfest tensorflow machine-learning llm deep-learning tts pytorch jax gpu mlops cv llm-serving model-serving machine-learning-platform mxnet nerual-network

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.