video-understanding

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

A curated list of action recognition and related area resources

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

[ICCV 2019] TSM: Temporal Shift Module for Efficient Video Understanding

[ECCV2024] Video Foundation Models & Data for Multimodal Understanding

An open-source toolbox for action understanding based on PyTorch

GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning

Awesome video understanding toolkits based on PaddlePaddle. It supports video data annotation tools, lightweight RGB and skeleton based action recognition model, practical applications for video tagging and sport action detection.

[NeurIPS 2022 Spotlight] VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training

Code & Models for Temporal Segment Networks (TSN) in ECCV 2016

SALMONN family: A suite of advanced multi-modal LLMs

awesome grounding: A curated list of research papers in visual grounding

Temporal Segment Networks (TSN) in PyTorch

[CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

🔥 🔥 🔥 A paper list of some recent Computer Vision(CV) works

temporal action detection with SSN

Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understanding

[ICCV 2023] MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressions

A collection of recent video understanding datasets, under construction!