zolotukhin's tracked open-source repos, sorted by stars.
Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon
