Papers

Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoids

Achieving robust humanoid hiking in complex, unstructured environments requires transitioning from reactive proprioception to proactive perception. However, integrating exteroception remains a significant challenge: mapping-based methods suffer from state estimation drift; for instance, LiDAR-based methods do not handle torso jitter well. Existing end-to-end approaches often struggle with scalability and training complexity; specifically, some previous works using virtual obstacles are implemented case-by-case. In this work, we present Hiking in the Wild, a scalable, end-to-end parkour perceptive framework designed for robust humanoid hiking. To ensure safety and training stability, we introduce two key mechanisms: a foothold safety mechanism combining scalable Terrain Edge Detection with Foot Volume Points to prevent catastrophic slippage on edges, and a Flat Patch Sampling strategy that mitigates reward hacking by generating feasible navigation targets. Our approach utilizes a single-stage reinforcement learning scheme, mapping raw depth inputs and proprioception directly to joint actions, without relying on external state estimation. Extensive field experiments on a full-size humanoid demonstrate that our policy enables robust traversal of complex terrains at speeds up to 2.5 m/s. The training and deployment code is open-sourced to facilitate reproducible research and deployment on real robots with minimal hardware modifications.

HumanoidHiking

Shaoting Zhu, Ziwen Zhuang, Mengjie Zhao · 982 views · Jan 12, 2026

CReF: Cross-modal and Recurrent Fusion for Depth-conditioned Humanoid Locomotion

CReF is a single-stage depth-conditioned humanoid locomotion framework that maps onboard proprioception and forward-facing depth directly to joint position targets, without explicit geometric intermediates. It couples proprioception and depth tokens via proprioception-queried cross-modal attention, fuses them with a gated residual block, and integrates temporal context with a GRU regulated by a highway-style output gate. A terrain-aware foothold placement reward extracts supportable candidates from foot-end point-cloud windows and rewards touchdowns near them. Full CReF leads all terrain categories and difficulty levels in simulation and transfers zero-shot to a physical AGIBOT X2 Ultra across handrail stairs, hollow pallets, reflective interference, and cluttered outdoor scenes.

HumanoidLocomotion

Yuan Hao, Ruiqi Yu, Shixin Luo · 1.3k views · Mar 31, 2026

ADAPT: Agile Diffusion Action Priors for Robust and Steerable Online Text-Driven Humanoid Control

We present ADAPT, an end-to-end framework for interactive, text-conditioned humanoid whole-body control. Unlike dominant text-to-motion pipelines that generate kinematic motions for a separate tracker, ADAPT solves language control with an end-to-end closed-loop control framework, where the robot must continuously respond to changing commands while maintaining balance, natural motion, and smooth transitions. ADAPT learns a diffusion-based action prior from text-labeled humanoid state-action trajectories, enabling diverse motion skills to be directly executed from language commands. To improve long-horizon robustness and smooth prompt switching, we train a lightweight residual reinforcement learning policy on top of the frozen diffusion controller. We further show that the same diffusion policy can be reused as a steerable text-conditioned motion prior for downstream task adaptation. Experiments demonstrate robust language-grounded skill execution, smooth interactive transitions, and style-preserving downstream control.

Diffusion policiesResidual RL

Yan Wu, Chenhao Li, Kaifeng Zhao · 1.1k views · Sep 1, 2026

Contact-Guided Exploration for Non-Prehensile Locomanipulation with Multi-Critic RL

The paper turns 25 grasp-algorithm candidates into a retractable exploration objective, separates task, exploration, and regularization signals with three value heads, and schedules their advantages during training. The full method reaches 94.1% simulation success with 4.4% tipover and transports unseen IKEA objects in 40/58 zero-shot hardware trials.

Multi-Critic RLIsaac Lab

Simone Tolomei, Mayank Mittal, Franco Angelini · 917 views · Aug 28, 2026

ZEST: Zero-shot Embodied Skill Transfer for Athletic Robot Control

Achieving robust, human-like whole-body control on humanoid robots for agile, contact-rich behaviors remains a central challenge, demanding heavy per-skill engineering and a brittle process of tuning controllers. We introduce ZEST (Zero-shot Embodied Skill Transfer), a streamlined motion-imitation framework that trains policies via reinforcement learning from diverse sources – high-fidelity motion capture, noisy monocular video, and non-physics-constrained animation – and deploys them to hardware zero-shot. ZEST generalizes across behaviors and platforms while avoiding contact labels, reference or observation windows, state estimators, and extensive reward shaping. Its training pipeline combines adaptive sampling, which focuses training on difficult motion segments, and an automatic curriculum using a model-based assistive wrench, together enabling dynamic, long-horizon maneuvers. We further provide a procedure for selecting joint-level gains from approximate analytical armature values for closed-chain actuators, along with a refined model of actuators. Trained entirely in simulation with moderate domain randomization, ZEST demonstrates remarkable generality. On Boston Dynamics' Atlas humanoid, ZEST learns dynamic, multi-contact skills (e.g., army crawl, breakdancing) from motion capture. It transfers expressive dance and scene-interaction skills, such as box-climbing, directly from videos to Atlas and the Unitree G1. Furthermore, it extends across morphologies to the Spot quadruped, enabling acrobatics, such as a continuous backflip, through animation. Together, these results demonstrate robust zero-shot deployment across heterogeneous data sources and embodiments, establishing ZEST as a scalable interface between biological movements and their robotic counterparts.

ZESTSim-to-Real

Jean Pierre Sleiman, He Li, Alphonsus Adu-Bredu · 891 views · Jan 30, 2026

Humanoid Seated Locomotion on Passive Mobile Chair

Research on omnidirectional seated locomotion for humanoids on passive chairs. Policies use proprioception only, outperforming standing in tracking. Analyzes regularization effects on convergence.

HumanoidSeated Locomotion

Kango Yanagida, Kazuki Miyazawa, Takato Horii · 493 views · Aug 28, 2026

LAC: Linear and Angular Compliance for Humanoid Whole-body Control

LAC is a general humanoid whole-body controller that simultaneously realizes commanded linear and angular compliance for wrenches applied to the upper body. Sampled force and couple events imposed on contact frames from human interaction data synthesize a large-scale compliant-response dataset; teacher-student RL then trains a single policy to track compliant motions under external wrenches, with sim and real experiments showing monotonic stiffness modulation and teleoperated loco-manipulation.

HumanoidWhole-Body Control

Yang Liu, Zhongkai Gu, Wei Zhu · 787 views · Aug 26, 2026

Beyond Imitation: Self-Improving Robot Policies via Off-Policy Q-Planning

Q-Planning freezes a large behaviour-cloning policy and trains an approximately one-billion-parameter off-policy Q function. At inference, Q performs single-step weighted averaging over BC action-chunk draws; during online self-improvement, both successful and failed rollouts update only Q. Ten iterations raise mean LIBERO success from 92.1% to 97.6%, while two bimanual real-robot tasks improve from 40%/25% to 90%/80%.

Q-LearningVLA

Varun Giridhar, Anant Khandelwal, Jeremy A. Collins · 517 views · Aug 21, 2026

Motion Priors Reimagined: Adapting Flat-Terrain Skills for Complex Quadruped Mobility

Reinforcement learning (RL)-based motion imitation methods trained on demonstration data can effectively learn natural and expressive motions with minimal reward engineering but often struggle to generalize to novel environments. We address this by proposing a hierarchical RL framework in which a low-level policy is first pre-trained to imitate animal motions on flat ground, thereby establishing motion priors. A subsequent high-level, goal-conditioned policy then builds on these priors, learning residual corrections that enable perceptive locomotion, local obstacle avoidance, and goal-directed navigation across diverse and rugged terrains. Simulation experiments illustrate the effectiveness of learned residuals in adapting to progressively challenging uneven terrains while still preserving the locomotion characteristics provided by the motion priors. Furthermore, our results demonstrate improvements in motion regularization over baseline models trained without motion priors under similar reward setups. Real-world experiments with an ANYmal-D quadruped robot confirm our policy's capability to generalize animal-like locomotion skills to complex terrains, demonstrating smooth and efficient locomotion and local navigation performance amidst challenging terrains with obstacles.

ANYmalQuadruped robots

Zewei Zhang, Chenhao Li, Takahiro Miki · 637 views · May 21, 2025

DELTA: Deformable Elevation-Based Local Terrain Attention Encoder for Sparse-Terrain Quadrupedal Locomotion

Stable quadrupedal locomotion on sparse terrain requires selecting state-relevant terrain evidence for precise foot placement. Model-based foothold planners provide precise foothold selection but rely heavily on explicit model assumptions. Recent attention-based map encoding (AME) studies show that end-to-end reinforcement learning (RL) can learn implicit foothold guidance. However, the computational cost of dense AME encoding grows with map resolution, limiting its scalability to fine-grained sparse terrain. We propose DELTA, a Deformable Elevation-Based Local Terrain Attention encoder. DELTA predicts state-conditioned sampling locations, forms terrain evidence tokens from adaptive local elevation patches, and attends only to a fixed-size token set. With fixed sampling and patch settings, DELTA's encoder cost is independent of map resolution. Experiments show that DELTA achieves final traversal performance comparable to AME at the standard resolution while improving learning efficiency. This fixed encoder cost enables the use of higher-resolution terrain maps, improving traversal on fine-grained sparse terrain. DELTA also demonstrates strong generalization to unseen mixed evaluation courses composed of continuous and discrete terrain elements. Beyond simulation, DELTA demonstrates successful sim-to-real transfer on RAIBO2. Analysis of the learned sampling offsets and attention weights shows that DELTA samples steppable regions and attends to terrain evidence relevant to future touchdowns without foothold labels or attention supervision.

Sim-to-RealQuadruped robots

Sanghyun Park, Moonkyu Jung, Jemin Hwangbo · 612 views · Aug 22, 2026

ABot-AgentOS: A General Robotic Agent OS with Lifelong Multi-modal Memory

Recent VLM and VLA systems have improved robotic perception and action prediction, yet long-horizon embodied agents still require a general runtime layer for reasoning, memory, tool use, verification, and cross-embodiment execution. We present ABot-AgentOS, a general robotic Agent Operating System that sits above low-level controllers and provides a deliberative agent layer for scene-conditioned planning, context-isolated skill execution, multi-stage verification, multi-modal memory, and edge-cloud collaboration. To evaluate such systems, we introduce EmbodiedWorldBench, an executable benchmark with 16 indoor, outdoor, and hybrid scenes, four difficulty levels, and over 200 tasks involving navigation, object search, NPC dialogue, dynamic events, and trace-grounded scoring. ABot-AgentOS further introduces Universal Multi-modal Graph Memory, a persistent source-grounded substrate that converts dialogue, visual observations, spatial context, temporal relations, and task traces into typed nodes and edges. A failure-driven self-evolution loop converts diagnosed memory failures into gated runtime evo-assets that are promoted only to later evaluation splits, preventing current-split ground-truth leakage while enabling continual improvement. On an initial EmbodiedWorldBench subset, ABot-AgentOS improves over a single-controller baseline in both task success and goal completion. Across memory benchmarks, ABot-AgentOS Static achieves 87.5 on LoCoMo, 59.9 on OpenEQA EM-EQA, 88.6 on Mem-Gallery, and 76.5 Acc@All on NExT-QA; self-evolution further improves LoCoMo to 88.7, OpenEQA to 60.4, and Mem-Gallery to 89.0. These results suggest that a general Agent OS layer can improve long-horizon embodied execution while providing persistent, auditable memory for continual interaction.

AgentOSEmbodiedWorldBench

Jiayi Tian, Shiao Liu, Yuting Xu · 771 views · Jul 11, 2026

Learning Athletic Humanoid Tennis Skills from Imperfect Human Motion Data

Human athletes demonstrate versatile and highly-dynamic tennis skills to successfully conduct competitive rallies with a high-speed tennis ball. However, reproducing such behaviors on humanoid robots is difficult, partially due to the lack of perfect humanoid action data or human kinematic motion data in tennis scenarios as reference. In this work, we propose LATENT, a system that Learns Athletic humanoid TEnnis skills from imperfect human motioN daTa. The imperfect human motion data consist only of motion fragments that capture the primitive skills used when playing tennis rather than precise and complete human-tennis motion sequences from real-world tennis matches, thereby significantly reducing the difficulty of data collection. Our key insight is that, despite being imperfect, such quasi-realistic data still provide priors about human primitive skills in tennis scenarios. With further correction and composition, we learn a humanoid policy that can consistently strike incoming balls under a wide range of conditions and return them to target locations, while preserving natural motion styles. We also propose a series of designs for robust sim-to-real transfer and deploy our policy on the Unitree G1 humanoid robot. Our method achieves surprising results in the real world and can stably sustain multi-shot rallies with human players. Project page: https://zzk273.github.io/LATENT/

LATENTSim-to-Real

Zhikai Zhang, Haofei Lu, Yunrui Lian · 688 views · Mar 13, 2026

As an Amazon Associate, we earn from qualifying purchases.