Dataset

Object Permanence

Contains 1.5M synthetic video-continuation examples across 150 cognitive tasks for world-model and video prediction training.

Hugging Face ↗Sep 15, 2026Code ↗

  • multimodal
  • object-permanence
  • video-prediction
  • synthetic
Grid of many physics simulation scenes showing dataset diversity and coverage
Grid of many physics simulation scenes showing dataset diversity and coverage

What it is

Synthetic video-continuation corpus for training and testing object permanence in world models across hand-designed cognitive tasks. 1.5M Blender-rendered video-continuation samples across 150 hand-designed tasks in 6 cognitive categories, with paired input/target clips, text prompts, trajectories, and metadata.

Key results

  • 1.5 million samples across 150 tasks
  • 1280x720 videos at 24 fps, 60 input + 60 target frames
  • 5 files per sample; CC BY-NC 4.0; 214 GB total

Useful for training and benchmarking video models on object permanence and physical reasoning.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.