Key result
An automated natural language processing pipeline calculated CHA2DS2-VASc scores from electronic health records with strong agreement to expert clinicians (average kappa 0.78).
Why the study?
The study aimed to develop and validate an open-source natural language processing pipeline to calculate stroke and bleeding risk scores from free-text electronic health record data.
Observational (n=10,030)
No
Effect estimate: kappa 0.78
Absolute Event Rate: 0.78% vs 0.85%
An open-source NLP pipeline can accurately extract clinical risk factors from unstructured electronic health records to calculate CHA2DS2-VASc scores and track real-world anticoagulation trends in atrial fibrillation.
May enable scalable CHA2DS2-VASc extraction from EHRs; leaves open prospective validation before clinical use.
Atrial fibrillation (AF) is the most common arrhythmia and significantly increases stroke risk. This risk is effectively managed by oral anticoagulation. Recent studies using national registry data indicate increased use of anticoagulation resulting from changes in guidelines and the availability of newer drugs. The aim of this study is to develop and validate an open source risk scoring pipeline for free-text electronic health record data using natural language processing. AF patients discharged from 1 st January 2011 to 1 st October 2017 were identified from discharge summaries (N=10,030, 64.6% male, average age 75.3 ± 12.3 years). A natural language processing pipeline was developed to identify risk factors in clinical text and calculate risk for ischaemic stroke (CHA 2 DS 2 -VASc) and bleeding (HAS-BLED). Scores were validated vs two independent experts for 40 patients. Automatic risk scores were in strong agreement with the two independent experts for CHA 2 DS 2 -VASc (average kappa 0.78 vs experts, compared to 0.85 between experts). Agreement was lower for HAS-BLED (average kappa 0.54 vs experts, compared to 0.74 between experts). In high-risk patients (CHA 2 DS 2 -VASc ≥2) OAC use has increased significantly over the last 7 years, driven by the availability of DOACs and the transitioning of patients from AP medication alone to OAC. Factors independently associated with OAC use included components of the CHA 2 DS 2 -VASc and HAS-BLED scores as well as discharging specialty and frailty. OAC use was highest in patients discharged under cardiology (69%). Electronic health record text can be used for automatic calculation of clinical risk scores at scale. Open source tools are available today for this task but require further validation. Analysis of routinely-collected EHR data can replicate findings from large-scale curated registries.
No takes yet. Share an insight, caveat, or question.
Bean et al. (2019) conducted an observational in Atrial fibrillation (n=10,030). Natural language processing (NLP) pipeline vs. Manual expert annotation was evaluated on Inter-rater agreement (Cohen's kappa) for CHA2DS2-VASc score between NLP algorithm and human experts (kappa 0.78). An automated natural language processing pipeline calculated CHA2DS2-VASc scores from electronic health records with strong agreement to expert clinicians (average kappa 0.78).
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: