cuda

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

NVIDIA cuML: GPU-Accelerated Machine Learning

A PyTorch Library for Accelerating 3D Deep Learning Research

Optimized primitives for collective multi-GPU communication

ArrayFire: a general purpose GPU library.

Fast inference engine for Transformer models

Tengine is a lite, high performance, modular inference engine for embedded device

Lightning fast C++/CUDA neural network framework

HIP: C++ Heterogeneous-Compute Interface for Portability

A retargetable MLIR-based machine learning compiler and runtime toolkit.

[ICLR2025, ICML2025, NeurIPS2025 Spotlight] Quantized Attention achieves speedup of 2-5x compared to FlashAttention, without losing end-to-end metrics across language, image, and video models.

Train, inspect, edit, automate, and export 3D Gaussian Splatting scenes from a single native application.

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.

LYGIA, it's a granular and multi-language (GLSL, HLSL, Metal, WGSL, WEGL and CUDA) shader library designed for performance and flexibility

Single C file, Realtime CPU/GPU Profiler with Remote Web Viewer

how to optimize some algorithm in cuda.

Jittor is a high-performance deep learning framework based on JIT compiling and meta-operators.

Open source neural network chess engine with GPU acceleration and broad hardware support.

Agent Skills for NVIDIA products — install into Claude Code, Codex, and other coding agents to run Physical AI, robotics, simulation, CUDA, and RAG workflows end to end.

cuda-oxide is an experimental Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign language bindings, just Rust.

A GPU-powered real-time analytics storage and query engine.

HeavyDB (formerly MapD/OmniSciDB)

RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

PyTorch native quantization for training and inference

Minkowski Engine is an auto-diff neural network library for high-dimensional sparse tensors

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

LLM speculative inference server for heterogeneous hardware & consumer GPUs

:boom::computer::boom: A data-parallel functional programming language