cuda

RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form building blocks for more easily writing high performance applications.

GPU accelerated decision optimization

Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.

Efficient Deep Learning Systems course materials

an implementation of Video Frame Interpolation via Adaptive Separable Convolution using PyTorch

Embedded language for high-performance array computations

A machine learning library with a TypeScript API and Rust backend. CUDA and WebGPU compatibility. Built to understand how ML frameworks and models work internally.

Jetson Nano with Ubuntu 20.04 image

A curated list of best cuda programming books

A throughput-oriented high-performance serving framework for LLMs

BitCracker is the first open source password cracking tool for memory units encrypted with BitLocker

A CUDA implementation of SIFT for NVidia GPUs (1.2 ms on a GTX 1060)

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

UniLab: A Heterogeneous Architecture for Robot RL Beyond GPU-Dominant Paradigms

CUDA Kernel Benchmarking Library

VUDA is a header-only library based on Vulkan that provides a CUDA Runtime API interface for writing GPU-accelerated applications.

Goal: Enable awesome tooling for Bazel users of the C language family.

A highly optimized LLM inference acceleration engine for Llama and its variants.

Thin, unified, C++-flavored wrappers for the CUDA APIs

gprMax is open source software that simulates electromagnetic wave propagation using the Finite-Difference Time-Domain (FDTD) method for numerical modelling of Ground Penetrating Radar (GPR)

C++ library for solving large sparse linear systems with algebraic multigrid method

cuTile Rust provides a safe, tile-based kernel programming DSL for the Rust programming language. It features a safe host-side API for passing tensors to asynchronously executed kernel functions.

Lighthouse 2 framework for real-time ray tracing

Python Computer Vision & Video Analytics Framework With Batteries Included

SIMD Library for Evaluating Elementary Functions, vectorized libm and DFT

cuVS - a library for vector search and clustering on the GPU

Graphics Processing Units Molecular Dynamics

3D geometry processing SDK: fast mesh boolean, mesh repair, decimation, remeshing, offset, point cloud triangulation and ICP registration. C++ with Python, C#, C and JavaScript bindings.

High-performance Vision library in Python. Scale your research, not boilerplate.

Train and serve LLMs at extreme speed and massive throughput.