Key result
Semi-automatic 123I-MIBG H/M ratio assessment improves inter-rater agreement over manual methods, achieving ~0.90 Kappa.
Why the study?
The effects of manual versus semi-automatic methods for assessing MIBG semi-quantitative indices in Parkinson’s disease patients were not well established in clinical settings.
Does a semi-automatic ROI method improve inter-rater agreement compared to a manual method for assessing 123I-MIBG heart-to-mediastinum ratios in patients with Parkinson's disease?
Cross-Sectional (n=35)
No
Does a semi-automatic ROI method improve inter-rater agreement compared to a manual method for assessing 123I-MIBG heart-to-mediastinum ratios in patients with Parkinson's disease?
Absolute Event Rate: 0.78% vs 0.45%
A semi-automatic method for assessing 123I-MIBG heart-to-mediastinum ratios significantly improves inter-rater agreement, particularly for inexpert readers, compared to manual ROI drawing.
May facilitate consistent 123I-MIBG interpretation across experience levels; leaves open impact on diagnostic accuracy and outcomes in Parkinson's disease.
Objective This study investigates the effects of manual and semi-automatic methods for assessing MIBG semi-quantitative indices in a clinical setting. Materials and methods We included 123I-MIBG scans obtained in 35 patients with idiopathic Parkinson’s Disease. Early and late heart-to-mediastinum (H/M) ratios were calculated from 123I-MIBG images using regions of interest (ROIs) placed over the heart and the mediastinum. The ROIs were derived using two approaches: (i) manually drawn and (ii) semi-automatic fixed-size ROIs using anatomical landmarks. Expert, moderate-expert, and not expert raters applied the ROIs procedures and interpreted the 123I-MIBG images. We evaluated the inter and intra-rater agreements in assessing 123I-MIBG H/M ratios. Results A moderate agreement in the raters’ classification of pathological and non-pathological scores emerged regarding early and late H/M ratio values (κ = 0.45 and 0.69 respectively), applying the manual method, while the early and late H/M ratios obtained with the semi-automatic method reached a good agreement among observers (κ = 0.78). Cohen-Kappa values revealed that the semi-automatic method improved the agreement between expert and inexpert raters: the agreement improved from a minimum of 0.29 (fair, for early H/M) and 0.69 (substantial, in late H/M) with the manual method, to 0.90 (perfect, in early H/M) and 0.87 (perfect, in late H/M) with the semi-automatic method. Conclusion The use of the semi-automatic method improves the agreement among raters in classifying’ H/M ratios as pathological or non-pathological, namely for inexpert readers. These results have important implications for semi-quantitative assessment of 123I-MIBG images in clinical routine.
No takes yet. Share an insight, caveat, or question.
Boccalini et al. (2022) conducted a cross-sectional in Parkinson's disease (n=35). Semi-automatic fixed-size ROIs method vs. Manual-drawing ROIs method was evaluated on Inter-rater agreement (Fleiss' kappa) for early heart-to-mediastinum ratio classification. The semi-automatic method for assessing 123I-MIBG heart-to-mediastinum ratios improved agreement between expert and inexpert raters compared to the manual method, increasing Cohen's Kappa from 0.29 to 0.90 for early ratios.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: