rocm

Burn is a next generation tensor library and Deep Learning Framework that doesn't compromise on flexibility, efficiency and portability.

Open Machine Learning Compiler Framework

NumPy & SciPy for GPU

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

A nearly-live implementation of OpenAI's Whisper.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

LLM speculative inference server for heterogeneous hardware & consumer GPUs

A deep learning package for many-body potential energy representation and molecular dynamics

Large-scale LLM inference engine

Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3

Self-host the powerful Chatterbox TTS model. This server offers a user-friendly Web UI, flexible API endpoints (incl. OpenAI compatible), predefined voices, voice cloning, and large audiobook-scale text processing. Runs accelerated on NVIDIA (CUDA), AMD (ROCm), and CPU.

stdgpu: Efficient STL-like Data Structures on the GPU

UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

RDNA-native LLM inference engine in Rust.

Go with your own intelligence - Go applications that directly integrate llama.cpp for local inference using hardware acceleration.

Dockerfiles for the various software layers defined in the ROCm software platform