Answers are grounded in this paper and cite their sources.
The kappa statistic is commonly used for quantifying inter-rater agreement on a nominal scale.In this review article we discuss five interpretations of this popular coefficient.Kappa is a function of the proportion of observed and expected agreement, and it may be interpreted as the proportion of agreement corrected for chance.Furthermore, kappa may be interpreted as the average category reliability as well as an intraclass correlation.
No takes yet. Share an insight, caveat, or question.
Matthijs J. Warrens (2015) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: