Answers are grounded in this paper and cite their sources.
A technique is presented for obtaining a rapid estimate of reliability between judges, with special reference to qualitative judgments. It is shown that reliability and discrimination are independent and that estimates of both are needed. A method of obtaining an independent estimate of multi-judge discrimination is developed. It is shown that the size of item-samples is specified by the latter method. Tests of significance for both reliability and discrimination are described.
No takes yet. Share an insight, caveat, or question.
Desmond S. Cartwright (1956) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: