Repo

WeMM-Embedding

Produces unified embeddings for text, image, video, visual-doc, and interleaved inputs, with truncatable Matryoshka vectors and vLLM/SGLang serving.

GitHub ↗Aug 25, 2026Paper ↗

  • multimodal
  • embedding-models
  • retrieval
  • matryoshka
Scaling curve and benchmark bars showing WeMM-Embedding outperforming baselines across tasks
Scaling curve and benchmark bars showing WeMM-Embedding outperforming baselines across tasks

What it is

Universal multimodal embedding models for text, images, videos, visual documents, and interleaved inputs, with SOTA results on MMEB-v2 and MMEB-v3. Generate a single embedding space for text, images, videos, visual documents, and interleaved multimodal inputs, with selectable Matryoshka dimensions for smaller vectors.

Key results

  • MMEB-v2: 2B scores 77.9 avg, ahead of Qwen3-VL-Embedding 2B at 73.2
  • MMEB-v3: 9B scores 59.5 overall vs Qwen3-VL-Embedding 8B at 53.5
  • 2B at 256 dims retains 98.7% of full image/video performance on MMEB-v2

Shows one embedding model can cover text, image, video, and visual-document retrieval without giving up top benchmark performance.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.