Externally validated models for predicting incident AF in EHRs, such as CHA2DS2-VASc (c-statistic 0.679; 95% CI 0.620-0.736), demonstrate moderate predictive ability and high risk of bias.
Systematic Review
What is the discriminative performance of multivariable prediction models for incident atrial fibrillation in community-based electronic health records?
Existing prediction models for incident atrial fibrillation in EHRs, such as CHA2DS2-VASc and HATCH, show only moderate discriminative ability and are limited by high risk of bias, highlighting the need for better validated novel methods.
Estimación del efecto: summary c-statistic 0.679 (CHA2DS2-VASc) (95% CI 0.620 to 0.736)
OBJECTIVE: Atrial fibrillation (AF) is common and is associated with an increased risk of stroke. We aimed to systematically review and meta-analyse multivariable prediction models derived and/or validated in electronic health records (EHRs) and/or administrative claims databases for the prediction of incident AF in the community. METHODS: Ovid Medline and Ovid Embase were searched for records from inception to 23 March 2021. Measures of discrimination were extracted and pooled by Bayesian meta-analysis, with heterogeneity assessed through a 95% prediction interval (PI). Risk of bias was assessed using Prediction model Risk Of Bias ASsessment Tool and certainty in effect estimates by Grading of Recommendations, Assessment, Development and Evaluation. RESULTS: -VASc (Congestive heart failure, Hypertension, Age>75 (2 points), Stroke/transient ischemic attack/thromboembolism (2 points), Vascular disease, Age 65-74, Sex category) (summary c-statistic 0.679; 95% CI 0.620 to 0.736; 95% PI 0.531-0.811) and HATCH (Hypertension, Age, stroke or Transient ischemic attack, Chronic obstructive pulmonary disease, Heart failure) (summary c-statistic 0.669; 95% CI 0.600 to 0.732; 95% PI 0.513-0.803) models resulted in a c-statistic with a statistically significant 95% PI and moderate discriminative performance. No model met eligibility for inclusion in meta-analysis if studies at high risk of bias were excluded and certainty of effect estimates was 'low'. Models derived by machine learning demonstrated strong discriminative performance, but lacked rigorous external validation. CONCLUSIONS: Models externally validated for prediction of incident AF in community-based EHR demonstrate moderate predictive ability and high risk of bias. Novel methods may provide stronger discriminative performance. SYSTEMATIC REVIEW REGISTRATION: PROSPERO CRD42021245093.
Nadarajah et al. (Mon,) conducted a systematic review in Incident atrial fibrillation. Multivariable prediction models (CHA2DS2-VASc and HATCH) was evaluated on Prediction of incident AF (discrimination measured by c-statistic) (summary c-statistic 0.679 (CHA2DS2-VASc), 95% CI 0.620 to 0.736). Externally validated models for predicting incident AF in EHRs, such as CHA2DS2-VASc (c-statistic 0.679; 95% CI 0.620-0.736), demonstrate moderate predictive ability and high risk of bias.