cactus-compute/cactus

@cactus-compute

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

↗ Open on GitHub

Stars

5,975

Forks

501

Language

C++

License

NOASSERTION

Last push

2 weeks ago

C++android ios ai llm framework llm-inference transformer whisper rag smartphone llms mobile on-device-ai edge edge-ai arm speech llamacpp mobile-inference quantiz

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.