Statistical Methods for the Analysis of Inter-Reader Agreement Among Three or More Readers

The inter-reader agreement is a key imaging interpretation-related outcome parameter in radiological research.The interpretation of medical images can be affected by the subjective assessment of readers.Therefore, the measure of inter-reader agreement is crucial.A substantial degree of reliability is required in clinical research involving image interpretation.To evaluate the extent of inter-reader agreement, measures of agreement such as kappa, intraclass correlation coefficient (ICC), and concordance correlation coefficient (CCC) are commonly employed 1.In a study with only two readers, statistical methods for analyzing interreader agreement can be easily applied and interpreted.Nevertheless, research studies may necessitate the involvement of three or more readers to enhance the generalizability of results across diverse clinical practices 2.Researchers maybe less acquainted with statistical