Paper

StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding

A benchmark-plus-system setup for hour-scale streaming agents: open-ended causal QA, then a decoupled frontend/backend architecture for interaction, memory, recall, and search.

arXiv ↗Aug 6, 2026Code ↗

  • multimodal
  • video understanding
  • benchmark
  • agents
Dataset statistics plus annotated task examples showing composition and coverage of benchmark
Dataset statistics plus annotated task examples showing composition and coverage of benchmark

What it is

Introduces StreamArena, an hour-scale open-ended benchmark for streaming video agents, and StreamMind, a two-tier agent that separates fast interaction from persistent multimodal memory. Instead of short MCQ clips or single-path streaming memory, it benchmarks hour-scale open-ended causal QA and uses a two-tier agent: frontend workers handle low-latency interaction/monitoring, backend workers build persistent multimodal memory and do recall/search.

Key results

  • 243 videos, 3,646 open-ended QA pairs; avg video length 88.8 min
  • StreamMind beats strongest streaming baselines by 58.4% RTP and 53.7% HR
  • Cuts pooled query-to-answer latency by 66.2% with the same Qwen3.5-397B backbone

Shows streaming agents need decoupled real-time interaction and persistent multimodal memory to handle long-horizon recall, proactive alerts, and tool use together.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.