jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

↗ Open on GitHub

Stars

21,333

Forks

1,812

Language

Python

License

Apache-2.0

Last push

7 days ago

Python macos llm openai-api apple-silicon mlx inference-server

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.