tensorrt-llm
Tracked open-source repos tagged tensorrt-llm, sorted by stars.
Related topics
Topics that frequently appear alongside tensorrt-llm on the same repo.
Recent risers
Repos created in the last 90 days, tagged tensorrt-llm.
No new repos tagged with this topic in the last 90 days.
- #1★ 7,952+76Star change over the last 7 days
- #2
📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉
★ 5,482+4Star change over the last 7 days - #3
A nearly-live implementation of OpenAI's Whisper.
★ 4,246+5Star change over the last 7 days - #4
Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3
★ 1,613+51Star change over the last 7 days - #5
An Optimized Speech-to-Text Pipeline for the Whisper Model Supporting Multiple Inference Engine
★ 578+1Star change over the last 7 days - #6
🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.
★ 512-2Star change over the last 7 days
