foundation-models

Making large AI models cheaper, faster and more accessible

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Janus-Series: Unified Multimodal Understanding and Generation Models

A Python library for anomaly detection across tabular, time series, graph, text, image, and audio data. 60+ detectors, benchmark-backed ADEngine orchestration, and an agentic workflow for AI agents.

⚡ TabPFN: Foundation Model for Tabular Data ⚡

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

OpenSquilla — Token-Efficient AI Agent with same budget, higher intelligence density

YuE: Open Full-song Music Generation Foundation Model, something similar to Suno.ai but open

Chronos: Pretrained Models for Time Series Forecasting

DeepSeek-VL: Towards Real-World Vision-Language Understanding

LimiX: Unleashing Structured-Data Modeling Capability for Generalist Intelligence https://arxiv.org/abs/2509.03505

TimeGPT-1: production ready pre-trained Time Series Foundation Model for forecasting and anomaly detection. Generative pretrained transformer for time series trained on over 100B data points. It's capable of accurately predicting various domains such as retail, electricity, finance, and IoT with just a few lines of code 🚀.

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese

Images to inference with no labeling (use foundation models to train supervised models).

EVA Series: Visual Representation Fantasies from BAAI

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

Awesome things about LLM-powered agents. Papers / Repos / Blogs / ...

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

A curated list of Graph/Transformer-based fraud, anomaly, and outlier detection papers & resources

Emu Series: Generative Multimodal Models from BAAI

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

Python library for time series forecasting using scikit-learn compatible models, statistical methods, and foundation models

日本語LLMまとめ - Overview of Japanese LLMs

TabICLv2: An open tabular foundation model