Repository navigation
world-models
- Website
- Wikipedia
Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixels with Hunyuan3D World Model
Mastering Diverse Domains through World Models
DIAMOND (DIffusion As a Model Of eNvironment Dreams) is a reinforcement learning agent trained in a diffusion world model. NeurIPS 2024 Spotlight.
Voyager is an interactive RGBD video generation model conditioned on camera input, and supports real-time 3D reconstruction.
Mastering Atari with Discrete World Models
Transformers are Sample-Efficient World Models. ICLR 2023, notable top 5%.
[CVPR 2024 Highlight] GenAD: Generalized Predictive Model for Autonomous Driving
🌐 3D and 4D World Modeling: A Survey
Dream to Control: Learning Behaviors by Latent Imagination
Generate large-scale explorable 3D scenes with high-quality panorama videos from a single image or text prompt.
A curated list of world models for autonomous driving. Keep updated.
A most Frontend Collection and survey of vision-language model papers, and models GitHub repository. Continuous updates.
[ICCV 2025 ⭐highlight⭐] Implementation of VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memory
SpatialVID: A Large-Scale Video Dataset with Spatial Annotations
DayDreamer: World Models for Physical Robot Learning
ICCV 2025 | TesserAct: Learning 4D Embodied World Models
An open source code repository of driving world models, with training, inferencing, evaluation tools, and pretrained checkpoints.
A comprehensive survey of forging vision foundation models for autonomous driving, including challenges, methodologies, and opportunities.
World Model based Autonomous Driving Platform in CARLA 🚗
《多模态大模型：新一代人工智能技术范式》作者：刘阳，林倞