Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

↗ Open on GitHub

Stars

9,758

Forks

597

Language

C++

License

MIT

Last push

4 months ago

C++llm large-language-models llm-inference llama local-inference

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.