Key result
An algorithm using Intelligent Medical Objects interface terminology achieved nearly perfect agreement (Cohen's κ 0.99; 95% CI 0.98-1.00) with manual record review for categorizing cardiac events.
Why the study?
Can computer algorithms using electronic health record data accurately categorize acute coronary and heart failure events compared to manual record review?
Observational
Can computer algorithms using electronic health record data accurately categorize acute coronary and heart failure events compared to manual record review?
Detailed EHR coding systems like IMO interface terminology combined with clinical data can accurately identify and categorize coronary and heart failure events without the need for manual record review.
May facilitate scalable cardiac event classification in EHR studies; leaves open prospective validation in diverse cohorts.
INTRODUCTION: The advent of universal health care coverage in the United States and the use of electronic health records can make the medical record a disease surveillance tool. The objective of our study was to identify criteria that accurately categorize acute coronary and heart failure events by using electronic health record data exclusively so that the medical record can be used for surveillance without manual record review. METHODS: We serially compared 3 computer algorithms to manual record review. The first 2 algorithms relied on ICD-9-CM (International Classification of Diseases, 9th Revision, Clinical Modification) codes, troponin levels, electrocardiogram (ECG) data, and echocardiograph data. The third algorithm relied on a detailed coding system, Intelligent Medical Objects, Inc., (IMO) interface terminology, troponin levels, and echocardiograph data. RESULTS: Cohen's κ for the initial algorithm was 0.47 (95% confidence interval [CI], 0.41-0.54). Cohen's κ was 0.61 (95% CI, 0.55-0.68) for the second algorithm. Cohen's κ for the third algorithm was 0.99 (95% CI, 0.98-1.00). CONCLUSION: Electronic medical record data are sufficient to categorize coronary heart disease and heart failure events without manual record review. However, only moderate agreement with medical record review can be achieved when the classification is based on 4-digit ICD-9-CM codes because ICD-9-CM 410.9 includes myocardial infarction with elevation of the ST segment on ECG (STEMI) and myocardial infarction without elevation of the ST segment on ECG (nSTEMI). Nearly perfect agreement can be achieved using IMO interface terminology, a more detailed coding system that tracks to ICD9, ICD10 (International Classification of Diseases, Tenth Revision, Clinical Modification), and SnoMED-CT (Systematized Nomenclature of Medicine - Clinical Terms).
No takes yet. Share an insight, caveat, or question.
Kottke et al. (2013) conducted an observational in Acute coronary and heart failure events. Computer algorithms using electronic health record data vs. Manual record review was evaluated on Agreement with manual record review (Cohen's κ) (Cohen's κ 0.99, 95% CI 0.98-1.00). An algorithm using Intelligent Medical Objects interface terminology achieved nearly perfect agreement (Cohen's κ 0.99; 95% CI 0.98-1.00) with manual record review for categorizing cardiac events.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: