Apples and Oranges: An Empirical Comparison of Commonly Used Indices of Interrater Agreement.

Empirical comparison of common indices of interrater agreement indicated that the indices are not directly comparable in regard to the magnitude of the estimates produced or the information conveye...