referring-expression-comprehension

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework

[CVPR'23] Universal Instance Perception as Object Discovery and Retrieval

[CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale

[CVPR2023 Highlight] GRES: Generalized Referring Expression Segmentation

[CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception

[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions

A curated list of papers and resources related to Described Object Detection, Open-Vocabulary/Open-World Object Detection and Referring Expression Comprehension. Updated frequently and pull requests welcomed.

A benchmark dataset for GRES and GREC [CVPR2023 Highlight]

[CVPR2020] Multi-task Collaborative Network for Joint Referring Expression Comprehension and Segmentation, CVPR2020 (oral)

A detection/segmentation dataset with labels characterized by intricate and flexible expressions. "Described Object Detection: Liberating Object Detection with Flexible Expressions" (NeurIPS 2023).

Rex-Thinker: Grounded Object Refering via Chain-of-Thought Reasoning

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

A lightweight codebase for referring expression comprehension and segmentation

[ICASSP 2024] VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders

RefTeacher is a strong baseline method for Semi-Supervised Referring Expression Comprehension.

[ACMMM'25] Referring Expression Instance Retrieval and A Strong End-to-End Baseline

Repository for the paper "Collecting Visually-Grounded Dialogue with A Game Of Sorts"

Code and DataLoader for the Harlequin dataset 🎨 described in the paper "Harlequin: Color-driven Generation of Synthetic Data for Referring Expression Comprehension", presented at ICPR'24

MB-ORES: A Multi-Branch Object Reasoner for Visual Grounding in Remote Sensing

Florence-2 quick test