Answers are grounded in this paper and cite their sources.
Measures the quality of definitions in academic literature, suggesting improved tagging accuracy.
Second paper of the meta-tagging project. Paper I (doi:10.5281/zenodo.21432188) described a field-neutral tagging layer over academic literature, built under one non-negotiable rule: every tag must quote an exact sentence from the paper itself. The corpus holds 538 records across 86 disciplines, and a standing audit re-checked 18,416 evidence strings against their source text; three failed. This paper measures the decision that layer makes every time it assigns a tag. The moment one fixes which items fall under a category, a definition has been applied — usually without being stated, and always without being measured. A definition is treated as a binary classifier over cases the literature itself adjudicated; every adjudication carries a verified quotation; rival definitions are ranked in a single run. Before scoring, definitions pass three logical gates that no statistical measure detects: circularity, recursion without a base case, and a free parameter the author never fixed. We report inter-coder reliability on the act of application itself (κ = 0.547, n = 140), a measurement almost absent from the interpretive-tagging work we surveyed. Every number is reproducible from the scripts and data in the linked repository.
No takes yet. Share an insight, caveat, or question.
Shir Sivroni (2026) studied this question.
Synapse has enriched 8 closely related papers on similar clinical questions. Consider them for comparative context: