Repo

LOCUS

Predicts a box for a referring expression in one pass, then checks and corrects coordinate tokens in parallel until the box matches greedy decoding.

GitHub ↗Oct 26, 2026Paper ↗

  • multimodal
  • visual-grounding
  • draft-and-verify
  • refcoco
Annotated example showing draft/verify method with token-level corrections and IoU results.
Annotated example showing draft/verify method with token-level corrections and IoU results.

What it is

Referring-expression grounding that drafts a box in one pass, then verifies coordinate tokens in parallel to recover the model's greedy token box in fewer passes. Grounds text spans in images by predicting a one-pass draft box, then refining it with parallel token verification to return either the fast draft or the model's greedy coordinate-token box.

Key results

  • Exact mode reaches the model's greedy token box in 5.60 passes avg
  • Locus-2B exact runs at 102.2 ms vs 151.6 ms for vLLM token decoding
  • Locus-0.8B typical gains +4.52 [email protected] over Jag-0.8B on same backbone

Shows that box regression can be used as a speculative draft to accelerate token-based visual grounding without changing the final greedy output.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.