Answers are grounded in this paper and cite their sources.
When the raters participating in a reliability study are a random sample from a larger population of raters, inferences about the intraclass correlation coefficient must be based on the three mean squares from the analysis of variance table summarizing the results: between subjects, between raters, and error. An approximate confidence interval for the parameter is presented as a function of these three mean squares.
No takes yet. Share an insight, caveat, or question.
Fleiss et al. (1978) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: