dphnAI/sonar

Large-scale LLM inference engine

↗ Open on GitHub

Stars

1,847

Forks

210

Language

C++

License

AGPL-3.0

Last push

4 weeks ago

C++machine-learning cuda lora inference-engine rocm intel api-rest speculative-decoding tpu inferentia

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.