Paper

WorldSculpt: Generating Compositional Worlds from Grounded Videos

Adapts a frozen single-object 3D prior to posed multi-view object evidence, generating each object separately in canonical space and composing them in world space.

arXiv ↗Sep 4, 2026Code ↗

  • cv
  • 3d generation
  • multi-view reconstruction
  • scene understanding
Composite showing dataset's 3D assets and annotated scene reconstructions with title branding
Composite showing dataset's 3D assets and annotated scene reconstructions with title branding

What it is

Generates cluttered scenes as separate object meshes from grounded multi-view video by adapting a single-object 3D prior, without scene-level training. Instead of reconstructing one fused scene or training scene-level generators, it conditions a strong single-object 3D prior on posed multi-view object crops in a canonical frame, then places each generated mesh back into world coordinates.

Key results

  • Beats prior approaches across single-object, multi-object, and UE-MeshyScene
  • Gains grow as scenes become more crowded and heavily occluded

A single-object 3D generative prior can scale to hundreds of occluded scene objects when grounded by multi-view conditioning, without scene-level training.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.