mit-han-lab/TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

↗ Open on GitHub

Stars

961

Forks

102

Language

C++

License

MIT

Last push

2 years ago

C++cpp deep-learning large-language-models c on-device-ai quantization x86-64 edge-computing arm cuda-programming

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.