Skip to content
WORLD MODELS · TIMELINE

World Models: 36 Years from Internal Models to WAMs

1990–2026 · Five lineages · 33 milestones

Early explorationLatent-space eraVideo generation · Physical AI · VLAWAM unification1990200020102018202020222023202420252026Model-based RL · Latent DynamicsVideo-generation World ModelsJEPA Predictive EmbeddingsVLA · World Action ModelsEmbodied / Physical World ModelsWorld Models1990 · SchmidhuberPILCO2011 · Deisenroth & RasmussenWorld Models2018 · Ha & SchmidhuberPlaNet2018 · DeepMindMuZero2019 · DeepMindDreamer2019 · Hafner et al.DreamerV22020 · Hafner et al.TD-MPC2022 · Hansen et al.DreamerV32023 · Hafner et al.I-JEPA2023 · Meta AIGAIA-12023 · WayveUniSim2023 · GoogleSora2024 · OpenAIGenie2024 · DeepMindV-JEPA2024 · Meta AI1X World Model2024 · 1X TechnologiesGenie 22024 · DeepMindCosmos2025 · NVIDIAV-JEPA 22025 · Meta AIGenie 32025 · DeepMindRT-22023 · Google DeepMindOpenVLA2024 · Stanford et al.π02024 · Physical IntelligenceGR00T N12025 · NVIDIAHelix2025 · Figure AIWAMs Survey2026 · Fudan University · Shanghai Innovation Institute · NUSACT2023 · StanfordRDT / H-RDT2024 · Tsinghuaπ0.52025 · Physical IntelligenceOpenVLA-OFT2025 · Stanford · BerkeleyGR00T N1.72026 · NVIDIAXiaomi-Robotics-02026 · XiaomiGigaWorld-Policy-02026 · GigaWorld Team
The x-axis is non-linear (1990–2017 compressed). Hover a node for details.← swipe to explore the full timeline →
WAM PHYLOGENY · 2023–2026

Branching Evolution: From VLA to World Action Models

61 site-collected papers · four lineages · taxonomy per arXiv:2605.12090

Vertical axis is paper date (non-linear; the dense 2026 band is expanded). WAM unifies VLA's p(a|o,l) and world models' p(o′|o,a) into the joint distribution p(o′,a|o,l), splitting into cascaded (imagine, then act) and joint (one model generates both) families; the bottom band is the RoboDojo arena snapshot (Aug 2026, 34 models). Hover for details; click a node to open the paper.
PAPERSep 17, 2026

Navi-Agent: Unlocalized Monocular Navigation Agent

Vision-Language Navigation in Continuous Environments (VLN-CE) requires an embodied agent to execute long-horizon instructions in unknown environments. Existing zero-shot VLN-CE systems typically maintain spatial states through geometric localization or coordinate-based representations. Recent geometry-constrained navigation removes depth and globally consistent coordinates, but maintaining persistent spatial awareness for place confirmation, progress verification, and recovery remains challenging. We present Navi-Agent, a zero-shot VLN-CE agent that constructs a coordinate-free spatial state from visual observations and executed motion histories. Navi-Agent organizes this state as a navigation topology, where nodes represent visual places and edges represent motion transitions. This representation enables observation-based approximate self-localization, task progress verification, and visual revisitation-based recovery. Navi-Agent performs closed-loop navigation by decomposing instructions into sub-goals, executing local visual navigation, and verifying visited places through the constructed spatial state. Experiments on zero-shot VLN-CE benchmark and real-world robot platforms show that Navi-Agent achieves state-of-the-art performance among geometry-constrained methods while remaining competitive with approaches relying on geometric localization.

Xie, Wenyuan, Hong, Mengyang, Wang, Yongzhong

VLNVision-language navigation
PAPERSep 17, 2026

HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface

Large-scale vision-language-action (VLA) models provide powerful priors for robot manipulation, yet adapting them to a specific deployment remains challenging. Supervised fine-tuning (SFT) on task-specific demonstrations provides a step toward deployment, but faces two persistent limitations: static data provide limited coverage of out-of-distribution states, and standard imitation objectives do not distinguish progressing behavior from less useful data. Interactive post-training can address these limitations, but typically requires repeated policy execution and human intervention on a physical robot. We introduce HIL-UMI, a policy-guided Universal Manipulation Interface (UMI) framework for robot-free human-in-the-loop VLA post-training. During handheld UMI demonstrations, HIL-UMI queries the current policy on the same observation stream without executing its predictions. The Energy Score compares the human action trajectory with policy inference and triggers collection when their discrepancy indicates an out-of-distribution region. In a separate feedback loop, low online advantage predictions identify essential segments for refining a progress-based advantage estimator. The updated estimator then guides advantage-conditioned behavioral cloning using a balanced mixture of base demonstrations and new policy data. This design preserves the iterative and policy-aware nature of human-in-the-loop learning while decoupling data collection from robot deployment. Experiments on four real-world tasks spanning long-horizon and precise manipulation show that HIL-UMI achieves consistent improvement over SFT and benefits from both targeted collection and advantage refinement. Moreover, HIL-UMI outperforms HG-DAgger on Clean Up Table with lower per-frame collection time, suggesting a scalable path for VLA post-training across operators and locations.

Han, Zimu, Zeng, Yiming, Zhang, Jiyao

VLAHuman-in-the-Loop
PAPERSep 14, 2026

Dream-RSI: Recursive Self-Improvement through Evolving Worlds

Recursive self-improvement is becoming increasingly vital for autonomous AI agents, where progress hinges on discovering high-value solutions across complex domains. The driver of this process is effective exploration, however, managing and improving exploration strategies remains a major bottleneck. Current systems face a fundamental dilemma: fixed strategies fail to adapt as search spaces scale, while online policy optimization requires navigating vast meta-search spaces under delayed and expensive feedback over long-horizon rollouts. We introduce {Dream-RSI}, a framework for scalable and recursively self-improving exploration. A lightweight orchestration layer makes exploration explicit and programmable while leaving the underlying coding agent unchanged. Our key insight is that accumulated discovery history can serve as a replay simulator over the realized search space. By performing dreaming in the replay simulator constructed from historical discovery trees, {Dream-RSI} secures immediate, low-cost off-policy feedback to evaluate and refine exploration policies without invoking repetitive, expensive online evaluations. The improved policy is subsequently redeployed online to drive further discovery, continuously expanding the simulator pool in a self-improving loop. Across algorithm engineering, mathematical optimization, and GPU kernel engineering, {Dream-RSI} achieves competitive or improved discovery quality while substantially reducing discovery cost in several settings.

Tong Zheng, Xidong Wu, Zheng Zhang

Recursive self-improvementWorld Models

As an Amazon Associate, we earn from qualifying purchases.