Repository navigation

large-vision-language-model

Website
Wikipedia

BradyFU / Awesome-Multimodal-Large-Language-Models

✨✨Latest Advances on Multimodal Large Language Models

instruction-tuning instruction-following large-vision-language-model visual-instruction-tuning multi-modality in-context-learning large-language-models large-vision-language-models multimodal-chain-of-thought multimodal-in-context-learning multimodal-large-language-models chain-of-thought

14773

943

4 天前

PKU-YuanGroup / Video-LLaVA

【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

instruction-tuning large-vision-language-model multi-modal

Python

3227

233

5 个月前

InternLM / InternLM-XComposer

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

ChatGPT visual-language-learning multi-modality foundation gpt-4 instruction-tuning mllm multimodal vision-language-model language-model large-language-model large-vision-language-model 大语言模型 vision-transformer gpt

Python

2813

172

3 个月前

PKU-YuanGroup / MoE-LLaVA

Mixture-of-Experts for Large Vision-Language Models

large-vision-language-model mixture-of-experts moe multi-modal

Python

2148

134

5 个月前

yaotingwangofficial / Awesome-MCoT

Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey

chain-of-thought cot deepseek-r1 instruction-tuning large-vision-language-model multimodal multimodal-chain-of-thought multimodal-large-language-models openai-o1 reasoning survey mcts

470

1 天前

jqtangust / hawk

🔥 🔥 🔥 [NeurIPS 2024] Hawk: Learning to Understand Open-World Video Anomalies

anomaly-detection large-vision-language-model video-understanding anomaly Video video-anomaly-detection

Python

194

5 天前

MMStar-Benchmark / MMStar

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

evaluation large-language-models large-multimodal-models large-vision-language-model large-vision-language-models 大语言模型 llms multimodal multimodal-learning multimodality visual-question-answering

Python

175

7 个月前

yu-rp / apiprompting

[ECCV 2024] API: Attention Prompting on Image for Large Vision-Language Models

large-multimodal-models large-vision-language-model large-vision-language-models prompting vision-language-model visual-prompting

Python

6 个月前

richard-peng-xia / CARES

[NeurIPS'24] CARES: A Comprehensive Benchmark of Trustworthiness in Medical Vision Language Models

large-vision-language-model vision-language-model

Python

4 个月前

Orlando-CS / Awesome-VLA

✨✨latest advancements in VLA models(VIsion Language Action)

large-language-models large-vision-language-model multi-modality

5 天前

Ruiyang-061X / VL-Uncertainty

🔎Official code for our paper: "VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation".

large-vision-language-model uncertainty-estimation hallucination multi-modal uncertainty uncertainty-quantification vision-language vision-language-model

Python

1 个月前

SuperBruceJia / Awesome-Large-Vision-Language-Model

Awesome Large Vision-Language Model: A Curated List of Large Vision-Language Model

foundation-models large-language-models large-vision-language-model large-vision-language-models multimodal-large-language-models vision-and-language artificial-general-intelligence 人工智能机器视觉深度学习机器学习自然语言处理

7 个月前

ADL-X / LLAVIDAL

This is the offical repository of LLAVIDAL

action-recognition large-vision-language-model LLVM

Python

1 个月前

ai4ce / LUWA

[CVPR 2024 Highlight] The first benchmark for lithic use-wear analysis leveraging SOTA vision and vision-language models (DINOv2, GPT-4V), demonstrating AI performance surpassing that of expert archaeologists.

ai4science 机器视觉 large-vision-language-model

Jupyter Notebook

1 个月前

lucaswychan / quant-lvlm

Easy-to-use large vision language model pipeline for quantitative analysis

large-vision-language-model multimodal-learning PyTorch quantitative-finance

Python

2 个月前

amazon-science / THRONE

Code release for THRONE, a CVPR 2024 paper on measuring object hallucinations in LVLM generated text.

benchmark cvpr2024 hallucination hallucinations large-language-model large-language-models large-vision-language-model large-vision-language-models vision-language-model

Python

1 天前