An artificial intelligence model using 12-lead electrocardiograms detected hospital-diagnosed heart failure with an AUC of 0.86, which improved to 0.96 when validated with strict NT-proBNP thresholds.
Observational (n=69,027)
Yes
Does a deep learning model using electrocardiograms accurately detect heart failure?
A deep learning model trained on ECGs with NT-proBNP-validated labels can accurately detect heart failure, offering a scalable tool for addressing underdiagnosis.
Effect estimate: AUC 0.86 (95% CI 0.847-0.864)
Abstract The diagnosis of heart failure (HF) is resource-intensive, leading to severe underdiagnosis. This study proposes the use of a deep learning model to detect HF solely from electrocardiograms. HF has limited validity in diagnosis codes, lowering the viability of direct application of supervised learning. However, validating the codes with measured levels of circulating N-terminal proB-type natriuretic peptide (NT-proBNP) during training mitigates the impact of label noise. We developed and prospectively validated a neural network for HF detection, using a development cohort of 25,300 patients and an independent test cohort of 43,727 patients. The model achieved an AUC of 0.86 (95% CI 0.847–0.864) for hospital-diagnosed HF, which increased to 0.91 (95% CI 0.900–0.913) with age-adjusted NT-proBNP thresholds and 0.96 (95% CI 0.951–0.963) with stricter limits of 125 and 1000 ng/L. The model was externally validated using the MIMIC-IV cohort of 161,352 patients, yielding AUC values of 0.87 (95% CI 0.861–0.871), 0.90 (95% CI 0.895–0.908), and 0.96 (95% CI 0.950–0.964) with the same labelling strategies. Model predictions were further validated using echocardiographic assessments of diastolic function grade and the H2FPEF score, demonstrating that the model accurately captures both diastolic and systolic function. The model has been released as open source.
Stenhede et al. (Tue,) conducted a observational in Heart failure (n=69,027). Artificial intelligence-enabled electrocardiogram model was evaluated on Detection of hospital-diagnosed heart failure (AUC 0.86, 95% CI 0.847-0.864). An artificial intelligence model using 12-lead electrocardiograms detected hospital-diagnosed heart failure with an AUC of 0.86, which improved to 0.96 when validated with strict NT-proBNP thresholds.