Key result
EchoNet-Measurements achieves high accuracy versus sonographers for automated echocardiographic quantification.
Why the study?
Manual measurement of echocardiographic parameters is time-consuming and can be imprecise, leading to interest in artificial intelligence models to automate comprehensive echocardiographic measurement.
Does EchoNet-Measurements accurately automate echocardiographic measurements compared to manual sonographer assessment?
Does EchoNet-Measurements accurately automate echocardiographic measurements compared to manual sonographer assessment?
Answers are grounded in this paper and cite their sources.
Captured external expert commentary on this paper, strongest first. Original sources are linked where available.
“Our AI tool demonstrated accuracy and precision comparable to that of expert sonographers from two medical institutions. One of the primary benefits of automation is that it reduces examination time and produces more consistent readings.”
“This is more interpretable and potentially more robust. [Previous AI models] just tell you what the model is thinking without a sense of why they think it's mild, moderate, or severe. Whereas in this model, our approach will recreate the types of measurements that cardiologists use... that actually then get distilled into whether it's mild, moderate, or severe.”
An open-source deep learning model, EchoNet-Measurements, accurately automates 18 anatomic and Doppler echocardiographic measurements, demonstrating potential to reduce clinician burden and improve workflow.
BACKGROUND Accurate measurement of echocardiographic parameters is crucial for the diagnosis of cardiovascular disease and tracking of change over time; however, manual assessment requires time-consuming effort and can be imprecise. Artificial intelligence has the potential to reduce clinician burden by automating the time-intensive task of comprehensive measurement of echocardiographic parameters. OBJECTIVES The purpose of this study was to develop and validate open-sourced deep learning semantic segmentation models for the automated measurement of 18 anatomic and Doppler measurements in echocardiography. METHODS We trained models for the automated measurement of echocardiography parameters using data sets between 2011 and 2023 from Cedars-Sinai Medical Center (CSMC). The outputs of segmentation models were compared with sonographer measurements from temporal split data from CSMC and an external data set from Stanford Healthcare (SHC) to access accuracy and precision. RESULTS We used 877,983 echocardiographic measurements from 155,215 studies from CSMC to develop EchoNet-Measurements, an open-source deep learning model for echocardiographic annotation. The models demonstrated high accuracy when compared with sonographer measurements from held-out data from CSMC and an independent external validation data set from SHC. Measurements across all 9 B-mode and 9 Doppler measurements had high accuracy (mean coverage probability of 0.796 and 0.839 and mean relative difference of 0.120 and 0.096 on held-out test set from CSMC and external data set from SHC, respectively). When evaluated end-to-end on 2,103 temporally distinct studies at CSMC, EchoNet-Measurements had similar reasonable performance (mean coverage probability 0.803 and mean relative difference of 0.108). Performance was consistent across patient characteristics including age, sex, and atrial fibrillation, obesity status, and machine vendors. CONCLUSIONS EchoNet-Measurements achieves high accuracy in automated echocardiographic quantification and potential for assisting the clinicians in the echocardiography workflow. This open-source model provides the foundation for future developments in artificial intelligence applied to echocardiography.
No takes yet. Share an insight, caveat, or question.
Sahashi et al. (2025) studied Cardiovascular disease (n=155,215). EchoNet-Measurements vs. Manual sonographer measurements was evaluated on Accuracy of 18 anatomic and Doppler measurements (mean coverage probability and mean relative difference). EchoNet-Measurements achieved high accuracy for automated echocardiographic quantification compared to sonographers, with a mean coverage probability of 0.796 to 0.839 across validation datasets.
Synapse has enriched 10 related papers. Consider them for comparative context: