Paper

Ropedia W0: Scaling Loco-Manipulation World Models across Embodiments with Human Experience

Replaces robot-specific action conditioning with shared camera-pose and skeleton controls, so one video world model can predict human and robot loco-manipulation.

arXiv ↗Oct 19, 2026Code ↗

  • cv
  • robotics
  • world models
  • video prediction
  • imitation learning
title_header
title_header

What it is

A cross-embodiment egocentric world model for loco-manipulation, trained on 10k human and 3k robot hours with unified camera-pose and skeleton conditioning. Instead of embodiment-specific action interfaces, it conditions video prediction on a shared visual kinematic interface: camera poses for locomotion plus projected skeletons for manipulation, letting one model transfer across humans, grippers, and humanoids.

Key results

  • SOTA across DreamDojo, Ψ0, ω-HOME, Xp-Teleop, and AgiBot
  • Human scaling: camera ATE drops 2.21→1.79 cm from 1k→10k h pretraining
  • Robot scaling on Ψ0: LPIPS improves 0.427→0.365 from 1k→10k h

Large-scale human egocentric pretraining transfers to robot world modeling when locomotion and manipulation are expressed in a shared kinematic format.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.