Paper

TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMs

An interval-set grounding approach for video MLLMs that pairs verified multi-span supervision with matching-free Wasserstein RL over temporal supports.

arXiv ↗Jul 19, 2026Code ↗

  • cv
  • video grounding
  • multimodal llms
  • reinforcement learning
Benchmark comparison bars across datasets plus grounding dimension taxonomy showing method superiority
Benchmark comparison bars across datasets plus grounding dimension taxonomy showing method superiority

What it is

A video MLLM for temporal grounding that predicts sets of evidence intervals and trains with interval-set supervision plus a matching-free Wasserstein RL reward. Instead of single-span labels and overlap-only rewards, it treats evidence as an interval set end-to-end: builds verified multi-span long-video labels and optimizes decoded interval sets with exact 1D Wasserstein plus tIoU, avoiding fragile segment matching.

Key results

  • 4B beats Qwen3.5-397B-A17B on all 7 benchmarks by 7.5 avg mIoU
  • 2B/4B/8B improve over Qwen3-VL backbones by 14.2/13.0/18.1 mIoU
  • Temporal Wasserstein restores preferences in 75.8% of all-zero-tIoU GRPO groups

Temporal grounding improves when supervision and rewards operate on merged interval sets rather than matched spans or overlap alone.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.