The commonly used form of r wg. (J) can display irregular behavior, so four variants of this index were examined. An alternative index, r* wg. J , is recommended. This index is an inverse linear function of the ratio of the average obtained variance to the variance of uniformly distributed random error. r* wg.J is superficially similar to Cronbach’s α, but careful examination confirms that r* wg.J is an index of agreement, not reliability. Based on an examination of the small-sample behavior of r wg and r* wg.J , sample sizes of 10 or more raters are recommended.
No takes yet. Share an insight, caveat, or question.
Lindell et al. (1999) studied this question.
Synapse has enriched 5 related papers. Consider them for comparative context: