What it is
Expert-verified benchmark for evidence-grounded QA over very long professional documents, including cross-document and abstention cases. 1,345 expert-verified QA items over 292 public documents, split into 1,191 single-doc and 154 cross-doc questions, with page-level evidence, multimodal support, abstention cases, and per-question scores for 13 systems.
Key results
- 1,345 total questions: 1,191 single-doc + 154 cross-doc
- 292 documents from 6 professional domains
- 429 multimodal-evidence questions; 188 require None answers
Useful for benchmarking evidence-grounded long-context document QA with retrieval, reasoning, and abstention.