What it is
Benchmark of long-horizon engineering tasks in realistic project workspaces across four disciplines, aimed at evaluating agentic engineering work. Dev-set benchmark of realistic engineering workspaces across 4 disciplines, with drawings, specs, spreadsheets, solver scripts, and CAD/BIM or simulation tools; tasks require producing deliverables like code, calculations, models, schedules, and reports.
Key results
- 4 engineering disciplines
- Includes drawings, specs, spreadsheets, and solver scripts
- Uses CAD/BIM or simulation tools in the workspace
Useful for benchmarking agents on long-horizon, multi-tool engineering task execution.