Answers are grounded in this paper and cite their sources.
We propose a coefficient of agreement to assess the degree of concordance between two independent groups of raters classifying items on a nominal scale. This coefficient, defined on a population-based model, extends the classical Cohen’s kappa coefficient for quantifying agreement between two raters. Weighted and intraclass versions of the coefficient are also given and their sampling variance is determined by the Jackknife method. The method is illustrated on medical education data which motivated the research.
No takes yet. Share an insight, caveat, or question.
Vanbelle et al. (2009) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: