Inter-rater reliability of a classification systems for distal radius fractures using radiology text and x-rays: what really matters?

Even with descriptive texts from the radiology reports and x-ray images, DRF classification is complex and classifier experience not affecting classification. Generally, above fair agreement and interrater reliability was achieved, but the type and complexity of the classification task and the choice of agreement coefficient were important considerations in the reporting of agreement and reliability of the data.