Key result
Machine learning models show suboptimal performance predicting in-hospital HF mortality with ~57% sensitivity.
Why the study?
The efficiency of machine learning-based models for predicting in-hospital mortality in patients with heart failure remains a topic of debate.
Do machine learning models accurately predict in-hospital mortality in patients with heart failure?
Meta-Analysis
Do machine learning models accurately predict in-hospital mortality in patients with heart failure?
Machine learning models for predicting in-hospital mortality in heart failure patients show relatively high specificity but low sensitivity, indicating suboptimal predictive performance for positive events.
Answers are grounded in this paper and cite their sources.
Suboptimal performance warrants caution against clinical reliance on these models for heart failure risk stratification; challenges assumptions of high predictive accuracy.
BACKGROUND: The efficiency of machine learning (ML) based predictive models in predicting in-hospital mortality for heart failure (HF) patients is a topic of debate. In this context, this study's objective is to conduct a meta-analysis to compare and assess existing prognostic models designed for predicting in-hospital mortality in HF patients. METHODS: A systematic search of databases was conducted, including PubMed, Embase, Web of Science, and Cochrane Library up to January 2023. To ensure comprehensiveness, we performed an additional search in June 2023. The Prediction Model Risk of Bias Assessment Tool was employed to assess the validity and reliability of ML models. RESULTS: Our analysis incorporated 28 studies involving a total of 106 predictive models based on 14 different ML techniques. In the training data set, these models showed a combined C-index of 0.781, sensitivity of 0.56, and specificity of 0.94. In the validation data set, the models exhibited a combined C-index of 0.758, sensitivity of 0.57, and specificity of 0.84. Logistic regression (LR) was the most frequently used ML algorithm. LR models in the training set had a combined C-index of 0.795, sensitivity of 0.63, and specificity of 0.85, and these measures for LR models in the validation set were 0.751, 0.66, and 0.79, respectively. CONCLUSIONS: Our study indicates that although ML is increasingly being leveraged to predict in-hospital mortality for HF patients, the predictive performance remains suboptimal. Although these models have relatively high C-index and specificity, their ability to predict positive events is limited, as indicated by their low sensitivity.
No takes yet. Share an insight, caveat, or question.
Yan et al. (2024) conducted a meta-analysis in Heart failure. Machine learning predictive models was evaluated on In-hospital mortality prediction performance (C-index 0.758). Machine learning models for predicting in-hospital mortality in heart failure patients demonstrated suboptimal predictive performance, with a combined validation C-index of 0.758 and sensitivity of 0.57.
Synapse has enriched 10 related papers. Consider them for comparative context: