Owner · triton-inference-server

triton-inference-server

triton-inference-server's tracked open-source repos, sorted by stars.

7 repos

#1
server ↗@triton-inference-serverPython
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
★ 10,958+0Star change over the last 7 days
#2
tensorrtllm_backend ↗@triton-inference-server
The Triton TensorRT-LLM Backend
★ 944+1Star change over the last 7 days
#3
tutorials ↗@triton-inference-serverPython
This repository contains tutorials and examples for Triton Inference Server
★ 861+0Star change over the last 7 days
#4
pytriton ↗@triton-inference-serverPython
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
★ 848+0Star change over the last 7 days
#5
client ↗@triton-inference-serverC++
Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
★ 700+0Star change over the last 7 days
#6
python_backend ↗@triton-inference-serverC++
Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
★ 682+1Star change over the last 7 days
#7
model_analyzer ↗@triton-inference-serverPython
Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.
★ 527+1Star change over the last 7 days