EvolvingLMMs-Lab

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

A fork to add multimodal model training to open-r1

Fully Open Framework for Democratized Multimodal Training

NEO Series: Native Vision-Language Models from First Principles

A simple, unified multimodal models training engine. Lean, flexible, and built for hacking at scale.