Paper

ReWorld: An Interactive World Model with Long-Horizon Memory

Splits control and memory by per-head context during training, then uses pose-retrieved landmarks to preserve long-horizon recall under a fixed KV cache.

arXiv ↗Aug 24, 2026Code ↗

  • multimodal
  • world models
  • video generation
  • memory
Full pipeline diagram: data, model construction, streaming inference explaining the method
Full pipeline diagram: data, model construction, streaming inference explaining the method

What it is

Interactive world model that separates short-horizon control from long-horizon memory, then serves both under a fixed cache for real-time streaming video. Instead of training control and memory in one shared horizon, it splits them by attention window: most heads learn action following on short context, a few learn recall on full history, then pose-retrieved landmarks compress memory into a fixed cache.

Key results

  • 11.95° rotation error, best control fidelity among 6 recent baselines
  • Best camera-motion consistency and best generation quality in 3-axis eval
  • At 64s rollouts, a 12-chunk cache still regenerates the starting view

Long-horizon spatial recall can be retained in interactive video generation without sacrificing control or using an unbounded KV cache.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.