Paper

SolarWM: Open Data and Scalable Training for Long-Horizon Video World Models

A unified open stack that normalizes heterogeneous video data and trains causal world models across multiple backbones with bidirectional adaptation, AR init, and DMD.

arXiv ↗Sep 2, 2026Code ↗

  • cv
  • world models
  • video generation
  • diffusion models
Shows 3-stage training pipeline plus demo of long-horizon interactive generation results
Shows 3-stage training pipeline plus demo of long-horizon interactive generation results

What it is

Open framework and dataset stack for training interactive long-horizon video world models across multiple video backbones with a shared 3-stage recipe. Instead of model-specific pipelines and naive dataset mixing, it standardizes 10 video sources into one training contract and adapts diverse backbones with a shared 3-stage causal recipe while keeping native objectives.

Key results

  • 4 released models span 5B to 33B across 3 backbone families
  • 1.43M canonical clips from 10 datasets, totaling 25.85 TB
  • Minutes-to-hours real-time rollouts after training only on 5s sequences

Long-horizon interactive rollout can emerge from short-sequence training when data standardization and causal adaptation are aligned across backbones.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.