Skip to content
WORLD MODELS · TIMELINE

World Models: 36 Years from Internal Models to WAMs

1990–2026 · Five lineages · 33 milestones

Early explorationLatent-space eraVideo generation · Physical AI · VLAWAM unification1990200020102018202020222023202420252026Model-based RL · Latent DynamicsVideo-generation World ModelsJEPA Predictive EmbeddingsVLA · World Action ModelsEmbodied / Physical World ModelsWorld Models1990 · SchmidhuberPILCO2011 · Deisenroth & RasmussenWorld Models2018 · Ha & SchmidhuberPlaNet2018 · DeepMindMuZero2019 · DeepMindDreamer2019 · Hafner et al.DreamerV22020 · Hafner et al.TD-MPC2022 · Hansen et al.DreamerV32023 · Hafner et al.I-JEPA2023 · Meta AIGAIA-12023 · WayveUniSim2023 · GoogleSora2024 · OpenAIGenie2024 · DeepMindV-JEPA2024 · Meta AI1X World Model2024 · 1X TechnologiesGenie 22024 · DeepMindCosmos2025 · NVIDIAV-JEPA 22025 · Meta AIGenie 32025 · DeepMindRT-22023 · Google DeepMindOpenVLA2024 · Stanford et al.π02024 · Physical IntelligenceGR00T N12025 · NVIDIAHelix2025 · Figure AIWAMs Survey2026 · Fudan University · Shanghai Innovation Institute · NUSACT2023 · StanfordRDT / H-RDT2024 · Tsinghuaπ0.52025 · Physical IntelligenceOpenVLA-OFT2025 · Stanford · BerkeleyGR00T N1.72026 · NVIDIAXiaomi-Robotics-02026 · XiaomiGigaWorld-Policy-02026 · GigaWorld Team
The x-axis is non-linear (1990–2017 compressed). Hover a node for details.← swipe to explore the full timeline →
WAM PHYLOGENY · 2023–2026

Branching Evolution: From VLA to World Action Models

61 site-collected papers · four lineages · taxonomy per arXiv:2605.12090

Vertical axis is paper date (non-linear; the dense 2026 band is expanded). WAM unifies VLA's p(a|o,l) and world models' p(o′|o,a) into the joint distribution p(o′,a|o,l), splitting into cascaded (imagine, then act) and joint (one model generates both) families; the bottom band is the RoboDojo arena snapshot (Aug 2026, 34 models). Hover for details; click a node to open the paper.
PAPEROct 21, 2026

Agentic World Action Models

Recent world action models provide visual foresight and future prediction for robot manipulation, but lack explicit mechanisms for compositional skill reuse. Agentic robotics combines code-based planning and reasoning with reusable skills, but often lacks predictive grounding in physical dynamics. We introduce AW-0, an agentic world action model framework that integrates code-based planning with joint video and action prediction. We jointly model code, future video, and robot actions as three coupled generative streams within a unified mixture-of-transformers architecture. Within this architecture a code expert generates parameterized skill routines and control logic while video and action experts generate future visual states and low-level motor commands. Code serves two complementary roles: it structures multi-step prediction and control within the world model and represents skills as reusable programs for subsequent agentic execution. We further introduce an automated curation pipeline that labels robot and human video trajectories with aligned programs and consolidates recurring routines into reusable skill libraries. Evaluations on RoboTwin 2.0 and physical bimanual manipulation tasks show improved task performance over VLA and WAM baselines, alongside gains in language following, semantic reasoning and robustness, demonstrating that agentic code enables connection between planning, prediction and execution within WAMs.

Liu, Zhuoyang, Niu, Dantong, Zhang, Botong

World-action modelsVision-language-action (VLA)
PAPEROct 20, 2026

Real2Sem2Real: 3D Semantic Augmentations for Robot Learning from a Single Human RGB Demonstration

Human video scales easily and does not need robot hardware, but existing methods require depth sensing, overlay the robot onto 2D video, or generate data only for the demonstrated objects. We present Real2Sem2Real (R2Sem2R), a real-to-semantic-to-real pipeline that turns one monocular RGB video of a human demonstration into thousands of robot demonstrations across the semantic object instances of a category. R2Sem2R tracks the SE(3) pose of each object with DINOv3-distilled Gaussian splats, outperforming existing methods and FoundationPose with estimated metric depth. R2Sem2R then aligns digital cousins, each generated from one or a few photographs, to the demonstrated objects with a semantic alignment. This alignment matches whole objects and the functional regions of target objects, such as a coffee machine's tray. R2Sem2R maps the human hand to a feasible robot grasp that extends to the cousins. Robot demonstrations are generated either in IsaacSim, for photorealistic rendering, or MuJoCo, for contact physics, and R2Sem2R can generate over 2,000 episodes in about two hours. On two real robots and four tasks, we train a vision-language-action policy on data from one human video per task, and policies trained on our data match or exceed policies trained on teleoperation across diverse object instances. The project page is available at https://real2sem2real.github.io/.

Matthew Strong, Ankush K. Dhawan, Julien Poffet

Robot LearningHuman demonstrations

As an Amazon Associate, we earn from qualifying purchases.