Dataset

Into the Unknown

Contains 15 paper-based research tasks and 135 agent submissions with PDFs, event logs, and working files for open-ended follow-up paper writing.

Hugging Face ↗Oct 7, 2026Paper ↗Code ↗

  • llm
  • agents
  • scientific-discovery
  • benchmark
Pipeline diagram showing evaluation framework with direction, bar, and rubrics
Pipeline diagram showing evaluation framework with direction, bar, and rubrics

What it is

Benchmark of 15 scientist-authored follow-up research tasks with 135 agent runs, including papers, trajectories, and judged outputs. 15 open-ended research tasks built from real papers plus author-proposed follow-up directions, with 135 runs from 9 agents and artifacts spanning papers, full event trajectories, logs, and judged file systems.

Key results

  • 15 tasks from published or submitted papers
  • 135 submissions from 9 agents
  • Includes PDFs, JSON trajectories, logs, and file-system snapshots

Useful for benchmarking AI agents on end-to-end scientific research and follow-up paper generation.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.