mllm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Agent S: an open agentic framework that uses computers like a human

Mobile-Agent: The Powerful GUI Agent Family

[NeurIPS 2025] SpatialLM: Training Large Language Models for Structured Indoor Modeling

[CVPR'25] Official Implementations for Paper - MagicQuill: An Intelligent Interactive Image Editing System

From Chain-of-Thought prompting to OpenAI o1 and DeepSeek-R1 🍓

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

Official Repo For Pixel-LLM Codebase: Sa2VA (T-PAMI-26), SAMTok (CVPR-26), VRT (Arxiv-25), SaSaSa2VA (1-st solution for LSVOS)

[CVPR2026] Detect Anything via Next Point Prediction

Curated visual catalog of 155+ vision-language model (VLM/MLLM) architectures: papers, diagrams, training recipes, datasets, and a release timeline for multimodal AI agents.

Fully Open Framework for Democratized Multimodal Training

A family of lightweight multimodal models.

OpenEMMA, a permissively licensed open source "reproduction" of Waymo’s EMMA model.

NEO Series: Native Vision-Language Models from First Principles

[NeurIPS' 2025] JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

[NeurIPS 2025 spotlight] Official implementation for "FutureSightDrive: Thinking Visually with Spatio-Temporal CoT for Autonomous Driving"

[NeurIPS 2025] 4KAgent: Agentic Any Image to 4K Super-Resolution. An intelligent computer vision agent that can magically restore any image to perfect-4K!

🚀🚀🚀A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

This is a repository for listing papers on scene graph generation and application.

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Train your own 8B/14B LLaVA-training-like MLLM on RTX3090/4090 24GB.

Vision as Unified Multimodal Generation

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models

[ICLR 2025] FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning