mllm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Agent S: an open agentic framework that uses computers like a human

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

SpatialLM: Training Large Language Models for Structured Indoor Modeling

Code and models for ICML 2024 paper, NExT-GPT: Any-to-Any Multimodal Large Language Model

[CVPR'25] Official Implementations for Paper - MagicQuill: An Intelligent Interactive Image Editing System

Reasoning in LLMs: Papers and Resources, including Chain-of-Thought, OpenAI o1, and DeepSeek-R1 🍓

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

mPLUG-DocOwl: Modularized Multimodal Large Language Model for Document Understanding

Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

🚀🚀🚀 A collection of some awesome public YOLO object detection series projects and the related object detection datasets.

🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos

A family of lightweight multimodal models.

Eagle: Frontier Vision-Language Models with Data-Centric Strategies

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

OpenEMMA, a permissively licensed open source "reproduction" of Waymo’s EMMA model.

🚀🚀🚀A collection of some awesome public projects about Large Language Model(LLM), Vision Language Model(VLM), Vision Language Action(VLA), AI Generated Content(AIGC), the related Datasets and Applications.

✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models

JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agent

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization