Paper

Causal-rCM: A Unified Teacher-Forcing and Self-Forcing Open Recipe for Autoregressive Diffusion Distillation in Streaming Video Generation and Interactive World Models

A staged recipe that uses teacher-forcing CM to initialize few-step causal video diffusion, then self-forcing DMD to refine on rollout states.

arXiv ↗Jun 24, 2026Code ↗

  • cv
  • llm
  • video generation
  • diffusion distillation
  • autoregressive modeling

What it is

Extends rCM to autoregressive video diffusion by pairing teacher-forcing consistency distillation with self-forcing DMD for few-step streaming video generation and world models. Instead of relying on KD or self-forcing alone, it uses teacher-forcing consistency models as offline, mode-covering initialization, then self-forcing DMD for on-policy refinement in causal video diffusion.

Key results

  • 84.63 VBench-T2V with distilled 2-step causal Wan2.1-1.3B
  • 84.63 VBench-T2V also at 1-step, leading reported streaming results
  • Teacher-forcing sCM/MeanFlow converges 10× faster than dCM

Shows that offline teacher-forcing consistency training is the strongest setup for stabilizing and improving on-policy self-forcing distillation in autoregressive video diffusion.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.