A sweep for the failure that cost two cycles: of 234 analysis directories holding a non-empty results file, only 5 are cited by no entry at all - so the backlog is real but small, and one of the five contains a defect in a committed scan
also called the results backlog is 2.1% · which computed results were never written up · 115 directories are mentioned in prose but carry no data.script
After twice discovering finished calculations that nobody had written down, this checks all of them at once. Almost everything has been written up - five directories out of two hundred and thirty-four have not, and one of those five records a flaw in a screen the project still relies on.
The same thing, for a scientist
Cycle 139 found a dead agent's **two completed headline measurements** sitting unread in a JSON file while the coordinator wrote a plan to recompute them. That was one beat, over 139 cycles and ~150 analysis directories. **This sweep asks the question systematically: which computed results has no graph entry ever cited?** Each directory lands in exactly one bucket, and the buckets sum [E1]: | bucket | directories | |---|---:| | `CITED_BY_DATA_SCRIPT` | **114** | | `MENTIONED_IN_PROSE_ONLY` | **115** | | **`UNCITED`** | **5** | | `NO_RESULTS_FILE` *(scaffolding, not a backlog item)* | 8 | 🔵 **The pre-registered W1 branch fires: only 5 of 234 results-holding directories (2.1%) are uncited**, so cycle 139's lapse was close to isolated rather than systemic. That is a reassuring negative and it is the main result. 🔴 **But the five are not nothing, and one of them matters.** `depmap-scan-line-identities` carries a key literally named `defect_found_in_the_source_scan`: the committed `depmap-kmt2a-selective-scan-full` fixes both comparison arms from the first gene with data, dropping **5 of 16** eligible KMT2A-rearranged lines from every one of its gene comparisons. **I verified that code path directly.** The others are `citation-title-drift` (217 KB, with `n_substantive` and `n_substantive_passing_strict` keys), `atlas-only-partners-replication-in-bioplex` (a BioPlex replication test of an interactome hypothesis, verdict *underpowered, not negative*), `king-independent-check-of-menin-surface-coordinates`, and `ledger-staleness-audit`. 🟠 **And the W3 condition did partly fire, which is why the buckets are kept apart.** **115 directories are mentioned in prose but carry no `data.script` reference anywhere.** One is named in **263** entries. That is a provenance weakness rather than a backlog - the finding was written up, but no entry records which script produced it, so nobody can re-run it from the graph alone.
| script | analyses/which-computed-results-were-never-written-up/run.py |
|---|---|
| status | run |
| run date | 2026-09-24 |
| n dirs | 242 |
| n dirs with results | 234 |
| uncited PCT of results holding | 2.1 |
| preregistered branch fired | W1 - mostly written up; W3 partly fired and the buckets are reported separately |
buckets — the numbers behind the chart
{
"MENTIONED_IN_PROSE_ONLY": 115,
"CITED_BY_DATA_SCRIPT": 114,
"UNCITED": 5,
"NO_RESULTS_FILE": 8
}the five uncited
[ "atlas-only-partners-replication-in-bioplex", "citation-title-drift", "depmap-scan-line-identities", "king-independent-check-of-menin-surface-coordinates", "ledger-staleness-audit" ]
measurements
[
{
"quantity": "analysis directories holding results that no entry cites",
"value": 5,
"unit": "directories",
"subject": "the 234 directories with at least one non-empty results file",
"universe": "242 analysis directories in total; 8 hold no results file and are scaffolding"
}
]- Write up the remaining four: citation-title-drift (the largest, and citation integrity is a standing theme here), atlas-only-partners-replication-in-bioplex, king-independent-check-of-menin-surface-coordinates and ledger-staleness-audit.
- 2.1% is the floor, not the size, of the write-up problem: a directory counts as cited if ANY entry names it, even when only part of its output was reported. A value-level version of this sweep already exists and found 39.7% of numeric leaves uncited.
- Separate the 115 prose-only directories into entries that predate the data.script convention and entries that simply omitted it. Only the second group is a provenance gap.
- E1strong confidence 4 of 5: Replicated in peer-reviewed work by more than one group.
Across 242 analysis directories, 234 hold at least one non-empty results file; of those, 114 are cited by an entry's data.script field, 115 are mentioned only in entry prose, and 5 are cited by no entry in any field, giving an uncited rate of 2.1%.
What this evidence cannot show
Run 2026-09-24 (cycle 140). Citation is detected by substring match on the directory name, so a directory renamed since its entry was written would read as uncited, and a directory whose name is a substring of another would read as cited. Directories with no parseable non-empty results file are excluded as scaffolding rather than counted. The uncited count is an UPPER bound: adding a search location can only move a directory out of that bucket.
Evidence that argues against this (2)
- Being cited by an entry does not mean the result was reported faithfully - it means the directory name appears. A directory could be cited by an entry that reports only part of its output, which is precisely what happened in cycle 139 for a beat whose node files WERE committed while two of its measurements were not. So 2.1% is the floor of the write-up problem, not its size.
- A prose-only mention is not necessarily weak provenance. Many older entries predate the data.script convention entirely, so the 115-directory bucket mixes genuine provenance gaps with entries written before the field existed. Dating them would separate the two and was not done here.
the sweep surfaced this directory; its key was literally named defect_found_in_the_source_scan
the value-level ancestor of this sweep: 39.7% of numeric leaves uncited against 2.1% of directories
the cycle-139 lapse this sweep generalises from one beat to all of them
third of the five uncited directories written up; its worklist was invisible until that sweep
the uncited directory whose worklist this resolves