Paper

GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modeling

Direct end-to-end latent training with explicit entropy to stop collapse, then a generation-first schedule that delays strong reconstruction pressure.

arXiv ↗Aug 29, 2026

  • cv
  • image generation
  • latent variable models
  • diffusion models
Compares four training pipelines, showing the method's core contribution and design
Compares four training pipelines, showing the method's core contribution and design

What it is

Enables direct end-to-end training of VAEs and latent priors without collapse by preserving posterior entropy and letting generation shape latents before reconstruction. Instead of freezing reconstruction-first latents or blocking generative gradients, it directly trains VAE+prior end to end with explicit posterior entropy and a generation-first schedule so the prior shapes a generation-friendly latent space before reconstruction tightens.

Key results

  • ImageNet-256: gFID 0.97 with CFG using SiT
  • ImageNet-256: gFID 1.45 without CFG using SiT
  • Text-to-image: MMDiT reaches 0.90 GenEval

Shows stable direct end-to-end latent learning is feasible when entropy counters prior pressure and generation shapes the latent space early.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.