vitoplantamura/OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RISC-V supported. Accelerated by XNNPACK. Python, C# and JS(WASM) bindings available.

↗ Open on GitHub

Stars

2,086

Forks

Language

C++

License

NOASSERTION

Last push

3 months ago

C++machine-learning stable-diffusion whisper raspberry-pi wasm webassembly onnx llama yolov8 mistral tinyml

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.

Related intel (0)

No related intel yet