benchmark

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

pytest fixture for benchmarking code

Fast and simple benchmarking for Rust projects

[pip install medmnist] 18x Standardized Datasets for 2D and 3D Biomedical Image Classification

Fast Compiler for C# Expression Trees and the lightweight LightExpression alternative. Diagnostic and code generation tools for the expressions.

SMAC: The StarCraft Multi-Agent Challenge

Modular Deep Reinforcement Learning framework in PyTorch. Companion library of the book "Foundations of Deep Reinforcement Learning".

Latest Advances on System-2 Reasoning

[NeurIPS '25] Knowledge Graph Generation from Any Text

GitHub Action for continuous benchmarking to keep performance

A better load generator for locust, written in golang.

LongBench v2 and LongBench (ACL 25'&24')

KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)

PDEBench: An Extensive Benchmark for Scientific Machine Learning

A compilation of Linux server benchmarking scripts.

Computational framework for reinforcement learning in traffic control

Benchmark for vector databases.

JMLR: OmniSafe is an infrastructural framework for accelerating SafeRL research.

OpenSTL: A Comprehensive Benchmark of Spatio-Temporal Predictive Learning

🚀 Fast prime number generator

ClickBench: a Benchmark For Analytical Databases

lzbench is an in-memory benchmark of open-source compressors

NoSQL Redis and Memcache traffic generation and benchmarking tool.

Model Zoo For OpenCV DNN and Benchmarks.

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

Python Performance Benchmark Suite

GLM-5.3-Flash × J-Space capability realization — benchmark presentation of the J-Space Cognition Suite

Official Implement of "ADBench: Anomaly Detection Benchmark", NeurIPS 2022.

Airspeed Velocity: A simple Python benchmarking tool with web-based reporting

Molecular Sets (MOSES): A Benchmarking Platform for Molecular Generation Models