Paper

The Trinity:Capability-Driven Recursive Self-Improvement for Multimodal Agents

Replaces surface task grouping with capability-based organization, then recursively builds simulators and evolves reusable agent modules for transfer across tasks.

arXiv ↗Oct 26, 2026Code ↗

  • llm
  • cv
  • multimodal
  • agentic systems
  • embodied ai
  • sim2real
Comprehensive pipeline diagram showing method components plus performance results panel
Comprehensive pipeline diagram showing method components plus performance results panel

What it is

A recursive self-improvement framework for multimodal agents that organizes tasks by shared capabilities, builds simulators from them, and evolves reusable agent modules. Instead of grouping tasks by modality or surface form, it reorganizes them by shared capability needs, then co-evolves simulated worlds and reusable harness modules along a capability tree.

Key results

  • +34 mean points on 28 training benchmarks
  • +26 mean points on 18 unseen benchmarks
  • Gains include 2 real-world embodied tasks

Shared capability structure can drive simulator creation and modular agent evolution that transfers across heterogeneous multimodal tasks.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.