Key result
The machine learning model based on administrative claim data predicted 1-year mortality of heart failure patients with a c-statistic of 0.777, outperforming conventional risk models.
Why the study?
Individual risk stratification is fundamental in heart failure management, and structured administrative claim data combined with machine learning can help develop an easy-to-use, highly accurate prediction model for 1-year mortality.
Does a machine learning-based model using administrative claim data improve prediction of 1-year mortality in hospitalized patients with heart failure compared to conventional risk models?
Observational (n=10,175)
Yes
Does a machine learning-based model using administrative claim data improve prediction of 1-year mortality in hospitalized patients with heart failure compared to conventional risk models?
Absolute Event Rate: 0.777% vs 0.713%
A machine learning model using easily obtainable administrative claim data accurately predicts 1-year mortality in hospitalized heart failure patients, outperforming conventional risk models.
May improve HF mortality prediction with claims data; hypothesis-generating and should not yet change practice.
AIMS: Individual risk stratification is a fundamental strategy in managing patients with heart failure (HF). Artificial intelligence, particularly machine learning (ML), can develop superior models for predicting the prognosis of HF patients, and administrative claim data (ACD) are suitable for ML analysis because ACD is a structured database. The objective of this study was to analyse ACD using an ML algorithm, predict the 1 year mortality of patients with HF, and finally develop an easy-to-use prediction model with high accuracy using the top predictors identified by the ML algorithm. METHODS AND RESULTS: Machine learning-based prognostic prediction models were developed from the ACD on 10 175 HF patients from the Japanese Registry of Acute Decompensated Heart Failure with 17% mortality during 1 year follow-up. The top predictors for prognosis in HF were identified by the permutation feature importance technique, and an easy-to-use prediction model was developed based on these predictors. The c-statistics and Brier scores of the developed ML-based models were compared with those of conventional risk models: Seattle Heart Failure Model (SHFM) and Meta-Analysis Global Group in Chronic Heart Failure (MAGGIC). A voting classifier algorithm (ACD-VC) achieved the highest c-statistics among the six ML algorithms. The permutation feature importance technique enabled identification of the top predictors such as Barthel index, age, body mass index, duration of hospitalization, last hospitalization, renal disease, and non-loop diuretics use (feature importance values were 0.054, 0.025, 0.010, 0.005, 0.005, 0.004, and 0.004, respectively). Upon combination of some of the predictors that can be assessed from a brief interview, the Simple Model by ARTificial intelligence for HF risk stratification (SMART-HF) was established as an easy-to-use prediction model. Compared with the conventional models, SMART-HF achieved a higher c-statistic {ACD-VC: 0.777 [95% confidence interval (CI) 0.751-0.803], SMART-HF: 0.765 [95% CI 0.739-0.791], SHFM: 0.713 [95% CI 0.684-0.742], MAGGIC: 0.726 [95% CI 0.698-0.753]} and better Brier scores (ACD-VC: 0.121, SMART-HF: 0.124, SHFM: 0.139, MAGGIC: 0.130). CONCLUSIONS: The ML model based on ACD predicted the 1 year mortality of HF patients with high accuracy, and SMART-HF along with the ML model achieved superior performance to that of the conventional risk models. The SMART-HF model has the clear merit of easy operability even by non-healthcare providers with a user-friendly online interface (https://hfriskcalculator.herokuapp.com/). Risk models developed using SMART-HF may provide a novel modality for risk stratification of patients with HF.
No takes yet. Share an insight, caveat, or question.
Tohyama et al. (2021) conducted an observational in Acute Decompensated Heart Failure (n=10,175). Machine learning-based prediction models (ACD-VC and SMART-HF) vs. Conventional risk models (SHFM and MAGGIC) was evaluated on 1-year all-cause mortality prediction (c-statistic) (95% CI 0.751-0.803). The machine learning model based on administrative claim data predicted 1-year mortality of heart failure patients with a c-statistic of 0.777, outperforming conventional risk models.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: