google-ai-edge/LiteRT-LM

@google-ai-edge

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

↗ Open on GitHub

Stars

6,358

Forks

707

Language

C++

License

Apache-2.0

Last push

7 days ago

C++on-device-ai edge-ai on-device-llm

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.