Paper

Multimodal Flow: Unified Flow Modeling of Language and Vision in Embedding Spaces

Replaces discrete or hybrid multimodal generation with a fully continuous chunk-based flow over text and image embeddings using one shared backbone.

arXiv ↗Sep 30, 2026Code ↗

  • cv
  • multimodal
  • flow matching
  • text-to-image
  • vision-language models
Full multimodal pipeline diagram with encoder, flow block, and decoder components
Full multimodal pipeline diagram with encoder, flow block, and decoder components

What it is

A unified multimodal generator that models both text and images as continuous embeddings with one flow objective and one sampling process, avoiding image tokenization and hybrid decoding. Instead of discrete image tokens or hybrid text/image objectives, it models both modalities continuously in embedding space with chunk-causal flow. Text blocks and images become ordered hyperchunks, enabling one shared flow backbone for bidirectional generation.

Key results

  • 0.821 GenEval, above D-DiT 0.65 and JanusFlow 0.63
  • 83.44 DPG-Bench, near SD3 Medium 84.08 and above JanusFlow 80.09
  • Under matched budgets: 0.7134 GenEval vs 0.6693 hybrid and 0.3744 discrete

Shows that fully continuous flow modeling can unify language and vision without losing competitiveness on either generation or understanding.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.