OAID's tracked open-source repos, sorted by stars.
Tengine is a lite, high performance, modular inference engine for embedded device
