Key result
Inverse probability weighting was the best performing propensity score method for achieving covariate balance in large cohorts, whereas covariate adjustment performed better in smaller subgroups.
Why the study?
To explore methodological challenges when using real-world evidence to estimate comparative-effectiveness in the context of Health Technology Assessment of direct oral anticoagulants in Scotland.
Does the choice of propensity score method affect comparative-effectiveness estimates of DOACs versus warfarin in patients with atrial fibrillation?
Cohort (n=50,018)
Does the choice of propensity score method affect comparative-effectiveness estimates of DOACs versus warfarin in patients with atrial fibrillation?
Answers are grounded in this paper and cite their sources.
The choice of propensity score method for comparative effectiveness research using real-world data should be tailored to sample size and data characteristics, with IPW performing best for large cohorts and covariate adjustment for smaller ones.
OBJECTIVE: To explore methodological challenges when using real-world evidence (RWE) to estimate comparative-effectiveness in the context of Health Technology Assessment of direct oral anticoagulants (DOACs) in Scotland. METHODS: We used linkage data from the Prescribing Information System (PIS), Scottish Morbidity Records (SMR) and mortality records for newly anticoagulated patients to explore methodological challenges in the use of Propensity score (PS) matching, Inverse Probability Weighting (IPW) and covariate adjustment with PS. Model performance was assessed by standardised difference. Clinical outcomes (stroke and major bleeding) and mortality were compared for all DOACs (including apixaban, dabigatran and rivaroxaban) versus warfarin. Patients were followed for 2 years from first oral anticoagulant prescription to first clinical event or death. Censoring was applied for treatment switching or discontinuation. RESULTS: Overall, a good balance of patients' covariates was obtained with every PS model tested. IPW was found to be the best performing method in assessing covariate balance when applied to subgroups with relatively large sample sizes (combined-DOACs versus warfarin). With the IPTW-IPCW approach, the treatment effect tends to be larger, but still in line with the treatment effect estimated using other PS methods. Covariate adjustment with PS in the outcome model performed well when applied to subgroups with smaller sample sizes (dabigatran versus warfarin), as this method does not require further reduction of sample size, and trimming or truncation of extreme weights. CONCLUSION: The choice of adequate PS methods may vary according to the characteristics of the data. If assumptions of unobserved confounding hold, multiple approaches should be identified and tested. PS based methods can be implemented using routinely collected linked data, thus supporting Health Technology decision-making.
No takes yet. Share an insight, caveat, or question.
Ciminata et al. (2022) conducted a cohort in Atrial fibrillation (n=50,018). Direct oral anticoagulants (DOACs) vs. Warfarin was evaluated on Covariate balance and comparative treatment effect estimation across different propensity score methods. Inverse probability weighting was the best performing propensity score method for achieving covariate balance in large cohorts, whereas covariate adjustment performed better in smaller subgroups.
Synapse has enriched 10 related papers. Consider them for comparative context: