Paper

S-Space: Exploring Spatial Workspace in Multimodal Language Models

A representation-analysis method that identifies a fixed 3D spatial subspace in MLLMs and reads or edits object coordinates to test and diagnose spatial reasoning.

arXiv ↗Oct 9, 2026Code ↗

  • cv
  • nlp
  • llm
  • multimodal
  • interpretability
  • spatial reasoning
  • representation analysis
Pipeline diagram showing method: 3D space to activations to spatial readout
Pipeline diagram showing method: 3D space to activations to spatial readout

What it is

Finds a linear internal spatial subspace in MLLMs where object tokens encode x/y/depth coordinates, and uses it to probe, edit, and diagnose spatial reasoning. Instead of treating spatial behavior as opaque, it exposes a fixed 3D linear workspace in hidden states: object tokens linearly encode left-right, up-down, and depth, readable across prompts and causally editable.

Key results

  • 99.31% on SpinBench vs 60.42-72.92% direct generation
  • 95.21% vs 60.96% direct on SpinBench for Qwen3.6-27B w/o premise
  • S-Space readout is near direct QA: 96.50% vs 97.83% on SpatialTunnel

Shows MLLMs often perceive spatial layouts correctly, but fail mainly in transforming and using those representations across viewpoints.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.