What it is
A 16.08 TB snapshot of arXiv with metadata, version history, source files, LaTeX, PDFs, and resolved TeX for 3.15M papers. ~3.15M arXiv papers across 9 parquet configs: metadata, 5.03M versions, 54.6M indexed files, 2.86M resolved TeX texts, plus source, LaTeX, PDF and PS contents with paths, sizes and SHA-256 digests.
Key results
- 3,148,796 papers and 5,030,612 reported versions
- 54,597,326 indexed files; 2,856,227 resolved TeX rows
- 16.08 TB parquet snapshot; mixed per-paper licenses
Useful for training and evaluating scientific retrieval, full-text modeling, and version-aware document pipelines.
