Paper

Mechanist: AI as a Scientific Instrument for Discovering the Mechanisms of Intelligence

An agentic loop for mechanistic discovery that generates, executes, verifies, and revises interpretability experiments using curated papers and analysis tools.

arXiv ↗Aug 12, 2026Code ↗

  • llm
  • mechanistic interpretability
  • ai agents
  • safety

What it is

An agentic interpretability system that autonomously generates, runs, verifies, and iterates on mechanism-discovery experiments for AI models. Unlike AI-scientist systems aimed at task solutions, it targets theory-level mechanism discovery: grounded by a 13k-paper interpretability KG, 43M-paper corpus, and 32 analysis tools, it proposes, tests, verifies, and iterates on mechanistic hypotheses.

Key results

  • Belief-head intervention improves Pythia-410M by +15.3% over baseline
  • Unsafe-response rate hits 48.6% vs 20.3% baseline, 18.3% control
  • Banana generation rises to 25.6% vs 2.5% baseline, 2.1% control

Mechanistic hypotheses can be autonomously turned into reliable experiments that expose hidden risks and yield actionable control knobs.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.