What question did this study set out to answer?

This paper aims to evaluate how definitions are applied in the tagging process of academic literature.

August 11, 2026Open Access

The Meta-Tagging Project II — Measuring Definitions: When Is a Definition Good, and How Would We Know?

View Full Paper

Ask AI

Bookmark

Authors

Randomized trial measures definitions in academic literature, highlighting how definitions can be evaluated.

This paper aims to evaluate how definitions are applied in the tagging process of academic literature.
Developed a tagging framework that quotes exact sentences from literature, audited 18,416 evidence strings.
Ranked definitions based on their application in tagging, checking for circularity and recursion.
Assessed inter-coder reliability with κ = 0.547 over 140 instances of tag application.
Inter-coder reliability was determined at κ = 0.547, indicating moderate agreement in classification.
Three logical gates were identified for definitions: circularity, recursion, and fixed parameters, which affect reliability.
The tagging process showed that definitions are often applied without explicit measurement.

Shir Sivroni (2026) studied this question.

View Full Paper

Ask AI

Bookmark