Key result
CineScribe structures cineCMR reports with ~92% accuracy and identifies ambiguous cases.
Why the study?
Interpretation of cine cardiac magnetic resonance reports is variable and free-text reports often contain imprecise language leading to miscommunication.
Does CineScribe accurately structure cineCMR reports and detect reporting ambiguity?
Does CineScribe accurately structure cineCMR reports and detect reporting ambiguity?
Answers are grounded in this paper and cite their sources.
CineScribe accurately structures cineCMR reports and uses model confidence to detect reporting ambiguity, potentially improving documentation consistency and identifying complex cases for expert review.
Cine Cardiac Magnetic Resonance (cineCMR) is widely regarded as a reference standard for evaluating left-ventricular wall motion, yet interpretation remains variable and free-text reports frequently contain imprecise language that can lead to miscommunication. In this study, we present CineScribe, a novel lightweight large language model (LLM) trained on expert-annotated cineCMR reports to convert free-text clinical reports into structured regional wall-motion abnormality (RWMA) representations and support standardized report generation from validated diagnostic findings. CineScribe achieves high performance on the report-structuring task with a macro-F1 of 0.92 (95% CI, 0.89-0.94), enabling automated extraction of RWMAs from routine clinical documentation. Beyond structuration, we introduce a Report-Level Confidence (RLC) score, derived from token-level conditional probabilities of the model, to quantify uncertainty during structured information extraction. Using an enriched multi-expert annotated dataset, we show that reduced model confidence is strongly associated with report ambiguity, which in turn corresponds to diagnostically complex cineCMR cases characterized by increased inter-observer variability during expert video review. CineScribe detected ambiguous reports with good discrimination with a ROC-AUC of 0.76 (95% CI, 0.68-0.85). Human evaluation using the QUEST framework demonstrated that reports generated from expert-validated findings were clinically appropriate, with 78% (95% CI, 74%-83%) rated as both correct and complete. Together, these results show that model confidence during clinical information extraction can serve as a practical indicator of ambiguity in medical reporting, enabling targeted expert review of diagnostically complex cases and supporting more consistent and efficient cineCMR documentation.
No takes yet. Share an insight, caveat, or question.
Benito et al. (2026) studied cine cardiac magnetic resonance (cineCMR) reports. CineScribe was evaluated on Report-structuring task (macro-F1 0.92, 95% CI 0.89-0.94). CineScribe achieved high performance on structuring cineCMR reports and detected ambiguous reports with a ROC-AUC of 0.76.
Synapse has enriched 10 related papers. Consider them for comparative context: