gpu

A Python framework for GPU-accelerated simulation, robotics, and machine learning.

a language for fast, portable data-parallel computation

FlashInfer: Kernel Library for LLM Serving

Run GUI applications and desktops in docker and podman containers. Focus on security.

HarfBuzz text shaping engine

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

Linux GPU Configuration And Monitoring Tool

High-performance TensorFlow library for quantitative finance.

AI-powered manga translator, written in Rust.

Where the GPU for the Web work happens!

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

NVIDIA cuML: GPU-Accelerated Machine Learning

The fastest and most memory efficient lattice Boltzmann CFD software, running on all GPUs and CPUs via OpenCL. Free for non-commercial use.

Optimized primitives for collective multi-GPU communication

Lightweight, high-performance HTML renderer for game and app developers.

On-device AI across mobile, embedded and edge for PyTorch

Time series forecasting with PyTorch

ArrayFire: a general purpose GPU library.

MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

Perf monitoring CLI tool for Apple Silicon

Lightning fast C++/CUDA neural network framework

📊 A simple command-line utility for querying and monitoring GPU status

Achieve state of the art inference performance with modern accelerators on Kubernetes

eBPF Observability - Distributed Tracing and Profiling

TVM Documentation in Chinese Simplified / TVM 中文文档

📷 A composable image editor using Core Image and Metal.

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

🛠 All-in-one web-based IDE specialized for machine learning and data science.

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.