Skip to main content
buildradar
Sign in

alibaba/rtp-llm

@alibaba

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

Stars
1,325
Forks
272
Language
Cuda
License
Apache-2.0
Last push
6 days ago
Cudallmgptllmopsllamainferencellm-servingmodel-serving

No related intel yet

This repo has not appeared in any of the sources the radar tracks. The collector runs on a schedule — check back once it covers this repo.