Key result
Lasso regression outperforms the Framingham model for incident MI prediction, achieving ~0.71 AUROC.
Why the study?
Many machine learning approaches are limited to classifying outcomes over a given time horizon rather than longitudinal prediction, and it is not well-known how to identify the optimal time horizon for clinical risk prediction of incident MI.
Do machine learning models improve classification accuracy for incident myocardial infarction compared to the Framingham Cox model in a population free of coronary heart disease?
Cohort (n=4,190)
Yes
Do machine learning models improve classification accuracy for incident myocardial infarction compared to the Framingham Cox model in a population free of coronary heart disease?
Machine learning techniques, particularly L1 logistic regression, can predict incident myocardial infarction with reasonable accuracy and outperform traditional Framingham models at moderate follow-up periods.
Answers are grounded in this paper and cite their sources.
May support ML for longer-term MI prediction; leaves open prospective validation before clinical adoption.
BACKGROUND: Many machine learning approaches are limited to classification of outcomes rather than longitudinal prediction. One strategy to use machine learning in clinical risk prediction is to classify outcomes over a given time horizon. However, it is not well-known how to identify the optimal time horizon for risk prediction. OBJECTIVE: In this study, we aim to identify an optimal time horizon for classification of incident myocardial infarction (MI) using machine learning approaches looped over outcomes with increasing time horizons. Additionally, we sought to compare the performance of these models with the traditional Framingham Heart Study (FHS) coronary heart disease gender-specific Cox proportional hazards regression model. METHODS: We analyzed data from a single clinic visit of 5201 participants of a cardiovascular health study. We examined 61 variables collected from this baseline exam, including demographic and biologic data, medical history, medications, serum biomarkers, electrocardiographic, and echocardiographic data. We compared several machine learning methods (eg, random forest, L1 regression, gradient boosted decision tree, support vector machine, and k-nearest neighbor) trained to predict incident MI that occurred within time horizons ranging from 500-10,000 days of follow-up. Models were compared on a 20% held-out testing set using area under the receiver operating characteristic curve (AUROC). Variable importance was performed for random forest and L1 regression models across time points. We compared results with the FHS coronary heart disease gender-specific Cox proportional hazards regression functions. RESULTS: There were 4190 participants included in the analysis, with 2522 (60.2%) female participants and an average age of 72.6 years. Over 10,000 days of follow-up, there were 813 incident MI events. The machine learning models were most predictive over moderate follow-up time horizons (ie, 1500-2500 days). Overall, the L1 (Lasso) logistic regression demonstrated the strongest classification accuracy across all time horizons. This model was most predictive at 1500 days follow-up, with an AUROC of 0.71. The most influential variables differed by follow-up time and model, with gender being the most important feature for the L1 regression and weight for the random forest model across all time frames. Compared with the Framingham Cox function, the L1 and random forest models performed better across all time frames beyond 1500 days. CONCLUSIONS: In a population free of coronary heart disease, machine learning techniques can be used to predict incident MI at varying time horizons with reasonable accuracy, with the strongest prediction accuracy in moderate follow-up periods. Validation across additional populations is needed to confirm the validity of this approach in risk prediction.
No takes yet. Share an insight, caveat, or question.
Simon et al. (2022) conducted a cohort in Incident myocardial infarction (MI) / coronary heart disease (n=4,190). Machine learning risk prediction models (L1/Lasso logistic regression, random forest, gradient boosted decision tree, support vector machine, k-nearest neighbor) across varying time horizons vs. Framingham Heart Study (FHS) coronary heart disease gender-specific Cox proportional hazards regression model was evaluated on Classification accuracy (AUROC) for incident myocardial infarction across follow-up time horizons. L1 (Lasso) logistic regression achieved the highest prediction accuracy for incident myocardial infarction at a 1500-day horizon, outperforming the Framingham model beyond 500 days.
Synapse has enriched 10 related papers. Consider them for comparative context: