Datasets attempted over time
Running total, by day.
Datasets attempted, new each day
Each dataset on the date of its first attempt.
Table: new each day, all datasets
| Date | Datasets attempted | Papers | Attempts | Claims tested | Findings about the data |
|---|---|---|---|---|---|
| 2026-10-13 | 4 | 4 | 4 | 44 | 25 |
| 2026-10-14 | 8 | 8 | 8 | 125 | 67 |
| 2026-10-15 | 5 | 5 | 7 | 58 | 65 |
| 2026-10-16 | 12 | 12 | 12 | 280 | 125 |
| 2026-10-17 | 9 | 9 | 9 | 193 | 93 |
| 2026-10-18 | 12 | 12 | 12 | 247 | 148 |
| 2026-10-19 | 6 | 6 | 6 | 114 | 60 |
| 2026-10-20 | 4 | 3 | 10 | 275 | 123 |
| 2026-10-21 | 6 | 6 | 7 | 226 | 70 |
| 2026-10-22 | 6 | 6 | 6 | 168 | 49 |
| 2026-10-23 | 1 | 1 | 1 | 11 | 10 |
| 2026-10-24 | 0 | 0 | 0 | 0 | 0 |
| 2026-10-25 | 0 | 0 | 0 | 0 | 0 |
| 2026-10-26 | 0 | 0 | 0 | 0 | 0 |
| 2026-10-27 | 7 | 7 | 7 | 166 | 57 |
| 2026-10-28 | 10 | 7 | 10 | 211 | 103 |
| 2026-10-29 | 7 | 6 | 7 | 157 | 81 |
| 2026-10-30 | 14 | 14 | 14 | 383 | 150 |
| 2026-10-31 | 21 | 16 | 21 | 527 | 212 |
| 2026-11-01 | 25 | 16 | 25 | 560 | 292 |
| 2026-11-02 | 18 | 11 | 18 | 556 | 221 |
| 2026-11-03 | 23 | 19 | 23 | 698 | 290 |
| 2026-11-04 | 7 | 7 | 7 | 171 | 66 |
| 2026-11-05 | 1 | 1 | 1 | 29 | 12 |
Outcomes of the 5,199 claims that rest on the dataset alone
Counted separately: claims using outside data (227), claims on data in other archives (575) and checks of the link to the paper (67)
227 claims that also use data from outside the dataset.
- 61 reproduced
- 16 partially reproduced
- 28 not reproduced
- 122 blocked
575 claims on data the paper deposited in other archives.
- 208 reproduced
- 64 partially reproduced
- 41 not reproduced
- 262 blocked
67 checks that the dataset is the data behind the paper.
- 40 reproduced
- 20 partially reproduced
- 6 not reproduced
- 1 blocked
A failure to reproduce is not a finding that the paper is wrong. It may be a failure of the attempt.
An outcome says what one attempt could recover from the data in a dataset, with the methods available to it. A “not reproduced” or “partially reproduced” outcome can come from a mistake or a limitation in the agent’s analysis, from methods the paper does not describe fully, from data that is not in the dataset, or from a dataset that differs from what the paper analysed. “Blocked” means the claim could not be tested at all.
Most attempts are made by AI agents. Where a page says so, the attempt has been checked by a second, independent agent, but neither is infallible. Every attempt links to its code, its reasoning and the ways its analysis differs from the paper’s. Authors who think an attempt is wrong can open an issue.
Outcomes by technique
See allWhy claims could not be tested
See allFindings about the data
See allVerification of attempted datasets
Most reproduced
See allVerified attempts with at least 5 claims on the dataset, by the share of claims reproduced; a partial reproduction counts as half.
Latest attempts
See allThe most recent attempts, verified or not.