Paper

MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis

Source-free environments replace source-visible repos, and teacher trajectories supervise full program construction from docs plus executable behavior.

arXiv ↗Jul 29, 2026

  • nlp
  • llm
  • code generation
  • agent distillation
  • software engineering
Headline benchmark comparison showing MindForge vs base gains across multiple tasks
Headline benchmark comparison showing MindForge vs base gains across multiple tasks

What it is

Builds source-free software-engineering environments from open-source CLIs and distills long program-synthesis trajectories into a 27B model. Instead of training on source-visible bug-fix tasks, it turns open-source CLI repos into source-free executable environments and distills whole-life-cycle synthesis trajectories from a strong teacher.

Key results

  • 49.51% on ProgramBench vs 37.98% for Qwen3.6-27B base
  • Beats DeepSeek V4 Pro on ProgramBench: 49.51% vs 47.80%
  • +31.00 pts on RepoZero-C2Rust; +14.16 on DeepSWE vs base

Whole-life-cycle, source-free synthesis trajectories transfer beyond from-scratch coding and improve broad software-engineering agent performance.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.