vision-transformer

OpenMMLab Detection Toolbox and Benchmark

pix2tex: Using a ViT to convert images of equations into LaTeX code.

This repository contains demos I made with the Transformers library by HuggingFace.

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Ingest, parse, and optimize any data format ➡️ from documents to multimedia ➡️ for enhanced compatibility with GenAI frameworks

SwinIR: Image Restoration Using Swin Transformer (official repository)

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

An ultimately comprehensive paper list of Vision Transformer/Attention, including papers, codes, and related websites

Efficient AI Backbones including GhostNet, TNT and MLP, developed by Huawei Noah's Ark Lab.

OpenMMLab Pre-training Toolbox and Benchmark

The first vision plugin for DeepSeek Harness, and the vision bridge for every text-only coding agent. Paste an image, get structured JSON evidence (OCR, layout, semantics). | 全网最强 DeepSeek Harness 外挂视觉插件，为 DeepSeek、GLM 等纯文本模型外挂视觉能力，粘贴图片即得结构化 JSON 证据（OCR、版面、语义）。

Scenic: A Jax Library for Computer Vision Research and Beyond

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

Efficient vision foundation models for high-resolution generation and perception.

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

EVA Series: Visual Representation Fantasies from BAAI

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

The official repo for [NeurIPS'22] "ViTPose: Simple Vision Transformer Baselines for Human Pose Estimation" and [TPAMI'23] "ViTPose++: Vision Transformer for Generic Body Pose Estimation"

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

An all-in-one toolkit for computer vision

This is a collection of our NAS and Vision Transformer work.

All-in-one training for vision models (YOLO, ViTs, RT-DETR, DINOv3): pretraining, fine-tuning, distillation.

[ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictions

A curated list of foundation models for vision and language tasks

UNetFormer: A UNet-like transformer for efficient semantic segmentation of remote sensing urban scene imagery, ISPRS. Also, including other vision transformers and CNNs for satellite, aerial image and UAV image segmentation.

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.

:fire: :fire: :fire: A paper list of some recent Computer Vision(CV) works

Repository of Vision Transformer with Deformable Attention (CVPR2022) and DAT++: Spatially Dynamic Vision Transformerwith Deformable Attention