Key result
XGBoost outperforms QRisk3 for 10-year ASCVD risk prediction with ~0.76 AUROC.
Why the study?
Currently available atherosclerotic CVD risk prediction models consider limited risk factors and outcomes, lack actionable advice, and were built with smaller or outdated cohorts.
Cohort (n=464,547)
Yes
Effect estimate: AUROC 0.7573 (95% CI 0.755-0.7595)
Absolute Event Rate: 0.7573% vs 0.725%
ML models may improve ASCVD risk prediction; hypothesis-generating in observational data and requires prospective validation before practice change.
Cardiovascular diseases (CVDs) are the primary cause of all death globally. Timely and accurate identification of people at risk of developing an atherosclerotic CVD and its sequelae is a central pillar of preventive cardiology. One widely used approach is risk prediction models; however, currently available models consider only a limited set of risk factors and outcomes, yield no actionable advice to individuals based on their holistic medical state and lifestyle, are often not interpretable, were built with small cohort sizes or are based on lifestyle data from the 1960s, e.g. the Framingham model. The risk of developing atherosclerotic CVDs is heavily lifestyle dependent, potentially making many occurrences preventable. Providing actionable and accurate risk prediction tools to the public could assist in atherosclerotic CVD prevention. Accordingly, we developed a benchmarking pipeline to find the best set of data preprocessing and algorithms to predict absolute 10-year atherosclerotic CVD risk. Based on the data of 464,547 UK Biobank participants without atherosclerotic CVD at baseline, we used a comprehensive set of 203 consolidated risk factors associated with atherosclerosis and its sequelae (e.g. heart failure). Our two best performing absolute atherosclerotic risk prediction models provided higher performance, (AUROC: 0.7573, 95% CI: 0.755-0.7595) and (AUROC: 0.7544, 95% CI: 0.7522-0.7567), than Framingham (AUROC: 0.680, 95% CI: 0.6775-0.6824) and QRisk3 (AUROC: 0.725, 95% CI: 0.7226-0.7273). Using a subset of 25 risk factors identified with feature selection, our reduced model achieves similar performance (AUROC 0.7415, 95% CI: 0.7392-0.7438) while being less complex. Further, it is interpretable, actionable and highly generalizable. The model could be incorporated into clinical practice and might allow continuous personalized predictions with automated intervention suggestions.
No takes yet. Share an insight, caveat, or question.
Kesar et al. (2022) conducted a cohort in Atherosclerotic cardiovascular disease (n=464,547). Machine learning risk prediction models (XGBoost and logistic regression) vs. Framingham and QRisk3 models was evaluated on Prediction of absolute 10-year atherosclerotic CVD risk (AUROC) (AUROC 0.7573, 95% CI 0.755-0.7595). The XGBoost machine learning model provided higher performance in predicting absolute 10-year atherosclerotic cardiovascular disease risk (AUROC 0.7573) compared to QRisk3 (AUROC 0.725) and Framingham (AUROC 0.680) models.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: