rlhf

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

Robust recipes to align language models with human and AI preferences

OpenClaw-RL: Train any agent simply by talking

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

Implement a reasoning LLM in PyTorch from scratch, step by step

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

Align Anything: Training All-modality Model with Feedback

A curated list of reinforcement learning with human feedback resources (continually updated)

🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.

A Doctor for your data

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

An Efficient and User-Friendly Scaling Library for Reinforcement Learning with Large Language Models

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

Textbook on reinforcement learning from human feedback

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

Awesome List for Agentic RL

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

WebGLM: An Efficient Web-enhanced Question Answering System (KDD 2023)

Recipes to train reward model for RLHF.

Secrets of RLHF in Large Language Models Part I: PPO

Xtreme1 is an all-in-one data labeling and annotation platform for multimodal data training and supports 3D LiDAR point cloud, image, and LLM.

Multimodal RL training framework for diffusion & omni models

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward

“AI-Compass”将为社区指引在 AI 技术海洋中航行的方向，无论你是初学者还是进阶开发者，都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势，并通过实践掌握从理论到落地的全过程。