Key result
A random forest classifier using raw features and SMOTE resampling predicted 6-month incident atrial fibrillation with an AUC of 0.65, outperforming a model based only on known risk factors.
Why the study?
Early detection of AF could improve outcomes through anticoagulation, but targeted screening requires an efficient method to identify patients at risk.
Does a machine-learning algorithm applied to harmonized EHR data improve the prediction of 6-month incident atrial fibrillation compared to known risk factors?
Observational (n=2,300,000)
Does a machine-learning algorithm applied to harmonized EHR data improve the prediction of 6-month incident atrial fibrillation compared to known risk factors?
A machine learning model using random forest and SMOTE resampling on harmonized EHR data outperformed traditional risk factor models for predicting 6-month incident atrial fibrillation, though overall classification accuracy remained modest.
Answers are grounded in this paper and cite their sources.
EHR-based ML modestly outperforms traditional factors for 6-month AF prediction; hypothesis-generating and should not yet change practice.
Atrial fibrillation (AF) is the most common sustained cardiac arrhythmia, whose early detection could lead to significant improvements in outcomes through appropriate prescription of anticoagulation. Although a variety of methods exist for screening for AF, there is general agreement that a targeted approach would be preferred. Implicit within this approach is the need for an efficient method for identification of patients at risk. In this investigation, we examined the strengths and weaknesses of an approach based on application of machine-learning algorithms to electronic health record (EHR) data that has been harmonized to the Observational Medical Outcomes Partnership (OMOP) common data model. We examined data from a total of 2.3M individuals, of whom 1.16% developed incident AF over designated 6-month time intervals. We examined and compared several approaches for data reduction, sample balancing (re-sampling) and predictive modeling using cross-validation for hyperparameter selection, and out-of-sample testing for validation. Although no approach provided outstanding classification accuracy, we found that the optimal approach for prediction of 6-month incident AF used a random forest classifier, raw features (no data reduction), and synthetic minority oversampling technique (SMOTE) resampling (F 1 statistic 0.12, AUC 0.65). This model performed better than a predictive model based only on known AF risk factors, and highlighted the importance of using resampling methods to optimize ML approaches to imbalanced data as exists in EHRs. Further studies using EHR data in other medical systems are needed to validate the clinical applicability of these findings.
No takes yet. Share an insight, caveat, or question.
Tiwari et al. (2019) conducted an observational in Incident Atrial Fibrillation (n=2,300,000). Machine-learning algorithms (random forest classifier with SMOTE resampling) vs. Predictive model based only on known AF risk factors was evaluated on Prediction of 6-month incident AF (AUC 0.65). A random forest classifier using raw features and SMOTE resampling predicted 6-month incident atrial fibrillation with an AUC of 0.65, outperforming a model based only on known risk factors.
Synapse has enriched 10 related papers. Consider them for comparative context: