benchmark

Point based and tiny object detection and localization code set of UCAS-VG

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

A benchmarking framework for the Julia language

This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

Open-source benchmark for browser AI agents on daily tasks.

CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.

BenchMARL is a library for benchmarking Multi-Agent Reinforcement Learning (MARL). BenchMARL allows to quickly compare different MARL algorithms, tasks, and models while being systematically grounded in its two core tenets: reproducibility and standardization.

The first-ever vast natural language processing benchmark for Indonesian Language. We provide multiple downstream tasks, pre-trained IndoBERT models, and a starter code! (AACL-IJCNLP 2020)

A repository of pretty cool datasets that I collected for network science and machine learning research.

A.S.E (AICGSecEval) is a repository-level AI-generated code security evaluation benchmark developed by Tencent Wukong Code Security Team.

Kotlin multiplatform benchmarking toolkit

[ICML 2024] TrustLLM: Trustworthiness in Large Language Models

AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

Federated Learning Benchmark - Federated Learning on Non-IID Data Silos: An Experimental Study (ICDE 2022)

Performance testing matchers for RSpec

A Benchmark of Text Classification in PyTorch

📖 Korean NLU Benchmark

A global network of probes to run network tests like ping, traceroute and DNS resolve

Visual Object Tracking

Open-source infrastructure that turns scattered SKILL.md files into curated, retrieval-ready agent-skill corpora—with retrieval and evaluation tooling included.

A more modern http framework benchmarker supporting HTTP/1 and HTTP/2 benchmarks.

CL-bench: A Benchmark for Context Learning

ParseBench - A Document Parsing Benchmark for AI Agents

Serialization library written in C++17 - Pack C++ structs into a compact byte-array without any macros or boilerplate code

Naive performance comparison of a few programming languages (JavaScript, Kotlin, Rust, Swift, Nim, Python, Go, Haskell, D, C++, Java, C#, Object Pascal, Ada, Lua, Ruby)

SpeechIO Leaderboard: a large, robust, comprehensive, benchmarking platform for Automatic Speech Recognition.

Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.

Dataset and benchmark for RAG on company internal documents.

Performance benchmarking and testing framework for .NET applications :chart_with_upwards_trend: