nobodywho-ooo's tracked open-source repos, sorted by stars.
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.