The corpus citation index reads `PMID nnnnnnnn` in prose and never the `pmid` citation field — it sees 1,908 of 3,991 papers, undercounts 872 of the rest, and its headline single-cell absence was an artefact
also called citation-index coverage audit · what-this-corpus-actually-cites is half an index · the single-cell gap that was mostly an instrument reading
A tool built to list every paper this project cites was actually listing only the papers someone happened to mention by number in a sentence, not the papers recorded in the citation slot where citations belong. Because of that, it reported that the project cites only eight single-cell papers and none about this leukaemia — when in fact it cites eighteen, and the single most important single-cell paper on KMT2A-rearranged infant leukaemia is cited in thirteen separate entries.
The same thing, for a scientist
`analyses/what-this-corpus-actually-cites/run.py` extracts PMIDs with `PMID_STRICT = re.compile(r"PMID[:\s]*(\d{7,8})", re.I)` applied to the **raw file text** [E1]. That pattern matches the prose form `PMID 35288693` and **cannot match the schema's own citation field**, `"pmid": "35288693"`, because no literal `PMID` token precedes the digits there. Every citation stored the way `SCHEMA.md` prescribes is therefore invisible to the index, and only the subset a queen also name-dropped in a sentence is counted. Measured against disk on 2026-09-23: **3,991 distinct PMIDs across 2,386 entries** (`pmid` field OR prose), against the index's **1,908 across 1,230 entries** — the index misses **2,083 papers (52.2%)**, carries **341 PMIDs that are not on disk at all**, and of the **1,567** PMIDs present in both, **872 (55.6%) have a wrong `cited_by` count**, always low [E1]. The KMT2A recombinome is recorded as cited 17 times; it is cited **163** times. The revumenib pivotal trial: 6 recorded, **96** true. This matters beyond bookkeeping because the index was used, this cycle, to assert a bounded absence: *single-cell / scRNA / CITE-seq / scATAC — 8 papers, none a KMT2A::AFF1 or infant-ALL single-cell study*. Re-run over the true PMID set with the same title regex and then **hand-classified** (rule 92): **18 genuine single-cell papers, not 8**, and the most-cited of all of them is Khabirova et al., *Nature Medicine* 2022, *Single-cell transcriptomics reveals a distinct developmental state of KMT2A-rearranged infant B-cell acute lymphoblastic leukemia* — **cited in 13 entries** and absent from the index entirely [E2][E3]. A second, Candelli et al. 2022 on relapse-initiating cells in MLL-rearranged infant ALL, is cited in 3 [E4]. The absence was real in its narrow form (this corpus under-cites single-cell work relative to metabolism at 39 papers) and **false in the form it was stated**.
What the regex can and cannot see
The index's own docstring says 'WHAT IS WALKED: every data/graph/nodes//.json. PMIDs are taken from anywhere' 1. The walk over files is correct — 2,603 files, all of them. The extraction is not.
PMID_STRICT = re.compile(r"PMID[:\s]*(\d{7,8})", re.I) # run.py line 79
for m in PMID_STRICT.finditer(raw): # raw = the whole file as TEXT
per_pmid[m.group(1)].add(nid)
| stored as | matches PMID[:\s]* ? |
|---|---|
"body_md": "... shown by Khabirova et al. (PMID 35288693) ..." | yes |
"citation": {"pmid": "35288693", ...} | no |
The second form is the one SCHEMA.md mandates for every evidence item. The comment beside the regex — 'STRICT form only: a bare 8-digit number is usually a coordinate here' — explains why the author tightened it, and the tightening is defensible in isolation; the defect is that no loosened path was added for the structured field. Parsing the JSON and walking to the pmid key solves both problems at once: it is exact, and a genomic coordinate is never under a pmid key.
The numbers, and which direction the error runs
Recomputed 2026-09-23 by analyses/what-the-citation-index-cannot-see/run.py, which walks the same 2,603 files and extracts pmid fields structurally 1:
| index | true | |
|---|---|---|
| distinct PMIDs | 1,908 | 3,650 (field-only) / 3,991 (field or prose) |
| entries citing ≥1 PMID | 1,230 | 2,386 |
| on disk, missing from index | — | 2,083 |
| in index, not on disk | — | 341 |
shared PMIDs with a wrong cited_by | — | 872 of 1,567 (55.6%) |
The worst individual disagreements are the corpus's own spine:
37019990 index=17 true=163 The KMT2A recombinome of acute leukemias in 2023
39121437 index=6 true=96 Menin Inhibition With Revumenib ... (NEJM pivotal)
41634341 index=26 true=78 DOT1L provides transcriptional memory through PRC1.1 antagonism
22327296 index=9 true=65 The same pocket in menin binds both MLL and JUND
30679323 index=4 true=49 Unraveling the cellular origin ... of infant leukaemia
The error runs low, always. A prose mention is a strict subset of the citations, so the index can only undercount. That is the dangerous direction for this project, because the index's stated purpose is to support bounded absences, and an undercounting index manufactures absences that are not there. It is rule 89's shape again — a metric that measures a proxy for the thing it is named after — and rule 93's — a query form that cannot reach half the records, so every figure built on it is a floor and none of them says so.
The 341 PMIDs in the index but not on disk are the mirror image and have a benign explanation: the index is dated 2026-09-24 and entries have been edited since, or the prose mention survives in a file the structural walk reads differently. They are not the load-bearing half and I did not chase them.
The single-cell question, re-answered
Same title regex, true PMID set, then every hit read by hand because a regex for single[- ]cell|snRNA|single nucle collides with 7SK snRNA, small nuclear RNA and single nucleotide polymorphism — 11 of the 29 raw hits are those collisions 2.
18 genuine single-cell papers cited by this corpus, led by:
| PMID | entries | paper |
|---|---|---|
| 35288693 | 13 | Khabirova 2022 Nat Med — KMT2A-r infant B-ALL developmental state 3 |
| 34663924 | 12 | Janssens 2021 Nat Genet — automated single-cell CUT&Tag, MLL leukaemia |
| 33352111 | 4 | human developmental haematopoiesis scRNA+scATAC |
| 34304246 | 3 | Candelli 2022 Leukemia — relapse-initiating cells, MLL-r infant ALL 4 |
| 35145224 | 3 | paediatric B-ALL MRD by single-cell analysis |
| 31792411, 39294124 | 1 each | single-cell multiomics of MPAL |
So the brief's claim — 'none is a KMT2A::AFF1 or infant-ALL single-cell study' — is false twice over, and the two papers that refute it are the two most-cited single-cell papers in the corpus. The narrow version survives: 18 is still small beside metabolism (39) and the field's single-cell output on KMT2A-r leukaemia is larger than 18 — a PubMed sweep for KMT2A[tiab] AND "single-cell"[tiab] returns 39 and MLL[tiab] AND "single-cell"[tiab] a further 26, of which several major ones are genuinely uncited (Blood 2022 single-cell multiomics of 25 KMT2A-r patients; Genome Biol 2022 single-cell Hi-C of KMT2A partner loci) 5.
What this costs, and the rule it argues for
A dispatch brief stated the eight-paper figure as a measurement, listed the eight by PMID, and instructed the beat to 'use that index before asserting any absence of your own'. The figure was presented with unusual care — 100% resolution rate, full enumeration, an invitation to check — and all of that care was spent on an instrument that reads prose.
This is the third instance in this project's registry of the same failure: rule 89 (a coverage metric that accepted any edge near the topic), rule 90 (a count persisted without its members), and now an index named for every PMID in every node file that reads one of the two places a PMID lives. What the three share is that nothing about the output looks wrong. 1,908 is a plausible number. 100% resolution is a genuinely reassuring control — and it controls the wrong thing, because every PMID the regex did find was real; the ones it missed were never offered for resolution.
The generalisable rule: a control that validates the items you found says nothing about the items you did not. A resolution rate is a precision measure. An index used to bound absences needs a recall measure, and the cheapest recall measure here is a second extraction path that works differently — parse the JSON, walk to the field — and a printed disagreement count between the two. That is four lines and it would have fired at 52%.
| script | analyses/what-the-citation-index-cannot-see/run.py |
|---|---|
| status | run |
| result summary | The citation index sees 1,908 of 3,991 distinct PMIDs (47.8%) and 1,230 of 2,386 citing entries, because its extraction regex requires a literal 'PMID' token and so cannot match the schema's own `"pmid":` citation field. 872 of the 1,567 shared PMIDs carry a wrong cited_by count, always low; the KMT2A recombinome reads 17 against a true 163. Its headline single-cell figure of 8 papers is 18 on the true set, and the two most-cited of those are KMT2A-r/MLL-r infant-ALL single-cell studies, contradicting the absence the figure was used to assert. |
| measured on | 2026-09-23 |
inputs
[ "data/graph/nodes/*/*.json (2,603 files)", "analyses/what-this-corpus-actually-cites/citation-index.json" ]
corrects
[ "analyses/what-this-corpus-actually-cites/citation-index.json", "the Q139 dispatch brief's single-cell bounded absence" ]
- This entry corrects a number, and a corrected number is exactly the kind of thing that goes stale next (rule 90). The 18 and the 3,991 are both re-derivable by the committed script, and neither should be quoted without re-running it.
- Do not read this as 'the single-cell gap was imaginary and needs no work'. Eighteen papers is genuinely thin, and the specific studies named in the sibling entries of this beat — the 25-patient HTAN multiome, the 419-sample single-cell CUT&Tag set — are genuinely absent. The correction is to the claim's form, not to the priority.
- Every per-topic count the original index reported — metabolism 39, relapse/MRD 26, condensates 22, splicing 15, CAR-T 14, degrons 14, 3D genome 10 — was computed on the same half-corpus. Re-running all of them on the true PMID set is one command; which of those absences also reverses?
- The index is dated 2026-09-24 and this audit 2026-09-23. Is the date in its header the generation date or a typo, and does any other analysis carry a future date that would make staleness undetectable?
- 341 PMIDs are in the index and not on disk. Are they entries that were deleted, entries whose prose was rewritten, or a second extraction defect running in the opposite direction?
- Should validate-graph.mjs assert agreement between a prose walk and a field walk, so this class of half-blind index cannot ship again?
- E1established confidence 5 of 5: Multiple independent lines of evidence; treated as settled in the field.dataset
The citation index extracts PMIDs with a prose-only regex and therefore misses every PMID stored in the schema's `pmid` citation field; measured against disk it sees 1,908 of 3,991 distinct PMIDs and 1,230 of 2,386 citing entries, and 872 of the 1,567 shared PMIDs carry a wrong cited_by count.
analyses/what-this-corpus-actually-cites/run.py (line 79, PMID_STRICT) and analyses/what-the-citation-index-cannot-see/run.py (this audit) · Oncofusion Knowledge Graph, coordinator and Q139 · Iqbal Lab oncofusion knowledge graph repository 2026What this evidence cannot show
This is a measurement of this repository at one commit on 2026-09-23, re-derivable by running the script. Both walks glob data/graph/nodes/*/*.json identically, so the difference is entirely in extraction, not in coverage of files. The 341 index PMIDs absent from disk were not individually investigated; they are consistent with entries edited between the index's generation date (2026-09-24 per its own header) and this audit.
Evidence that argues against this (1)
- In the index's defence, the prose-only regex is deliberate and documented: a bare 8-digit number in this corpus is often a genomic coordinate, and the author tightened the pattern to avoid that. The defect is not the tightening but the absence of a second, structural path for the field. The fix does not require loosening anything. Oncofusion Knowledge Graph coordinator 2026
- E2strong confidence 4 of 5: Replicated in peer-reviewed work by more than one group.dataset
Re-running the single-cell title search over the true PMID set returns 29 raw hits, of which 18 are genuine single-cell studies after hand classification; the other 11 are 7SK/small-nuclear-RNA and single-nucleotide-polymorphism collisions.
analyses/what-the-citation-index-cannot-see/true-index.py and true-index-results.json · Q139 · Iqbal Lab oncofusion knowledge graph repository 2026What this evidence cannot show
TITLE-ONLY. A single-cell study whose title does not carry the phrase is invisible to this count exactly as it was to the original — so 18 is a floor, not a total, and the same caveat applies to every per-topic count the original index reported (metabolism 39, relapse 26, condensates 22). This is rule 80's shape at the level of a title index rather than an abstract index. All 3,991 PMIDs resolved to a live PubMed record; there were zero unresolved.
Evidence that argues against this (1)
- The direction of the original claim survives the correction. Eighteen single-cell papers across 2,386 citing entries is still thin for an axis the PI names explicitly, and a PubMed sweep shows 39 records for KMT2A[tiab] AND "single-cell"[tiab] plus 26 for the MLL operand, several of them major and uncited here. The brief was wrong about the number and right about the direction. Q139 2026
- E3established confidence 5 of 5: Multiple independent lines of evidence; treated as settled in the field.paper
Khabirova et al. 2022 is a single-cell transcriptomic study of KMT2A-rearranged infant B-ALL, and it is cited in 13 entries of this corpus while being absent from the citation index.
Single-cell transcriptomics reveals a distinct developmental state of KMT2A-rearranged infant B-cell acute lymphoblastic leukemia · Khabirova E, Jardine L, Coorens THH, et al. · Nature Medicine 2022What this evidence cannot show
Cited here only to establish that the paper exists, is a single-cell KMT2A-r infant-ALL study, and is already used by this corpus. Its biological content is covered by the 13 entries that cite it (cell-state-early-lymphocyte-precursor, cell-state-pro-b-arrest, cell-type-mpp and others), not by this analysis entry.
Evidence that argues against this (1)
- Being cited 13 times is not the same as being USED. Most of the 13 entries cite Khabirova for a normal haematopoietic reference population (cell-type-mpp, cell-type-clp, cell-type-gmp, cell-type-pre-b) rather than for its KMT2A-r finding, so a reader could defend a weaker version of the brief's claim: the corpus cites the paper heavily and has not written an entry ABOUT the KMT2A-r developmental state it reports. That weaker claim is worth making and is different from 'none is a KMT2A::AFF1 or infant-ALL single-cell study'. Q139 2026
- E4established confidence 5 of 5: Multiple independent lines of evidence; treated as settled in the field.paper
A second KMT2A/MLL-rearranged infant-ALL single-cell study is cited in this corpus: relapse-initiating cells identified by single-cell transcriptomics.
Identification and characterization of relapse-initiating cells in MLL-rearranged infant ALL by single-cell transcriptomics · Candelli T, Schneider P, Garrido Castro P, et al. · Leukemia 2022What this evidence cannot show
Cited in 3 entries, led by cell-state-relapse-initiating-persister which covers its biology in full. Named here only as the second counter-example to the brief's stated absence.
Evidence that argues against this (1)
- Candelli et al. is an MLL-rearranged infant ALL cohort, not a KMT2A::AFF1-restricted one, and its partner breakdown is not stated in the abstract. A defender of the original claim could argue it is therefore not 'a KMT2A::AFF1 single-cell study' in the strict sense. The claim as written in the brief said 'KMT2A::AFF1 OR infant-ALL', and this paper is unambiguously the latter. Candelli T et al. 2022
- E5strong confidence 4 of 5: Replicated in peer-reviewed work by more than one group.database
Bounded literature sweep, both symbols, with querytranslations recorded: the single-cell literature on this fusion family is larger than what the corpus cites.
PubMed esearch via scripts/pubmed_safe.py, 2026-09-23 · Q139 · NCBI PubMed 2026What this evidence cannot show
Counts and querytranslations as executed: KMT2A[tiab] AND "single-cell"[tiab] -> "KMT2A"[Title/Abstract] AND "single-cell"[Title/Abstract], n=39. MLL[tiab] AND "single-cell"[tiab] -> "MLL"[Title/Abstract] AND "single-cell"[Title/Abstract], n=26. "t(4;11)"[tiab] AND "single-cell"[tiab] -> "t 4 11"[Title/Abstract] AND "single-cell"[Title/Abstract], n=2. KMT2A[tiab] AND "CITE-seq"[tiab] -> n=0 (genuine zero, warninglist 'No items found.'). KMT2A[tiab] AND scATAC[tiab] -> n=0 (genuine zero). Both symbol operands were run, as the legacy-MLL rule requires, and the MLL arm carried the relapse-initiating-cells paper that the KMT2A arm did not return. Title/abstract only; supporting figures not searched (rule 80).
Evidence that argues against this (1)
- A PubMed title/abstract count is itself a floor and a different instrument from the corpus index, so the two numbers are not strictly comparable. Rule 80 applies: a single-cell measurement reported only in a supporting figure of a paper whose title and abstract never say 'single-cell' is invisible to both counts. The honest reading is that both the corpus figure and the literature figure are floors, and the RATIO between them is what carries information, not either number alone. Oncofusion Knowledge Graph et al. 2026
both enumerate what the corpus holds on the cell-type/cell-state axis; this one measures the instrument that does the enumerating
one of the 13+3 entries whose single-cell citations the index could not see
the corrected single-cell sweep is what surfaced the uncited 25-patient KMT2A-r multiome behind this state
the corpus cites this dataset's paper 12 times and records the accession nowhere - the same failure to store the machine-readable identifier