Key result
Automated EMR algorithms achieved high PPVs for identifying T2DM (100%), hypertension (100%), and IHD (98%), with good severity agreement (κ=0.69-0.70), but performed poorly for heart failure (55%).
Observational (n=1,143)
Yes
Answers are grounded in this paper and cite their sources.
OBJECTIVES: The Italian project MATRICE aimed to assess how well cases of type 2 diabetes (T2DM), hypertension, ischaemic heart disease (IHD) and heart failure (HF) and their levels of severity can be automatically extracted from the Health Search/CSD Longitudinal Patient Database (HSD). From the medical records of the general practitioners (GP) who volunteered to participate, cases were extracted by algorithms based on diagnosis codes, keywords, drug prescriptions and results of diagnostic tests. A random sample of identified cases was validated by interviewing their GPs. SETTING: HSD is a database of primary care medical records. A panel of 12 GPs participated in this validation study. PARTICIPANTS: 300 patients were sampled for each disease, except for HF, where 243 patients were assessed. OUTCOME MEASURES: The positive predictive value (PPV) was assessed for the presence/absence of each condition against the GP's response to the questionnaire, and Cohen's κ was calculated for agreement on the severity level. RESULTS: The PPV was 100% (99% to 100%) for T2DM and hypertension, 98% (96% to 100%) for IHD and 55% (49% to 61%) for HF. Cohen's kappa for agreement on the severity level was 0.70 for T2DM and 0.69 for hypertension and IHD. CONCLUSIONS: This study shows that individuals with T2DM, hypertension or IHD can be validly identified in HSD by automated identification algorithms. Automatic queries for levels of severity of the same diseases compare well with the corresponding clinical definitions, but some misclassification occurs. For HF, further research is needed to refine the current algorithm.
No takes yet. Share an insight, caveat, or question.
Gini et al. (2016) conducted an observational in Type 2 diabetes, hypertension, ischaemic heart disease, and heart failure (n=1,143). Automated electronic medical record extraction algorithms vs. General practitioner questionnaire responses (clinical validation) was evaluated on Positive predictive value (PPV) for condition presence/absence and Cohen's kappa for disease severity agreement (PPV 100% (T2DM/HTN), 98% (IHD), 55% (HF); kappa 0.70 (T2DM), 0.69 (HTN/IHD), 95% CI 99-100% (T2DM/HTN), 96-100% (IHD), 49-61% (HF)). Automated EMR algorithms achieved high PPVs for identifying T2DM (100%), hypertension (100%), and IHD (98%), with good severity agreement (κ=0.69-0.70), but performed poorly for heart failure (55%).
Synapse has enriched 10 related papers. Consider them for comparative context: