Paper

MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering

Trains an agentic LLM to autonomously organize ML experiments, using outcome-filtered SFT and windowed RL over decisions between experiment results.

arXiv ↗Oct 15, 2026Code ↗

  • llm
  • nlp
  • agents
  • reinforcement learning
  • code generation
Full pipeline diagram showing MLE tasks, interaction harness, and agentic post-training method
Full pipeline diagram showing MLE tasks, interaction harness, and agentic post-training method

What it is

A 35B MoE agentic model for autonomous ML engineering, trained to improve multi-step experiment decisions from execution feedback in long runs. Instead of relying on hand-crafted workflows or single-step training, it trains the model to run long MLE loops itself: hierarchical agentic SFT plus windowed RL that rewards the multi-turn decisions between experiment results.

Key results

  • 72.7% medal rate on MLE-Bench Lite vs 37.9% for its base model
  • Matches GLM-5.3 and Kimi-K3 at 72.7% medal rate on MLE-Bench Lite
  • 84.8% Med+ and 50.0% gold on MLE-Bench Lite

Long-horizon post-training on real experiment feedback can turn a mid-size coding model into a competitive autonomous ML engineering agent.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.