Key result
NLP and imaging models improve VA heart failure dashboard accuracy for identifying HFrEF to ~89%.
Why the study?
The initial version of the Veterans Affairs national heart failure dashboard deployed in 2020 was imprecise and unreliable for identifying heart failure subtypes.
Does the inclusion of an imaging-quality hierarchy model and natural-language processing algorithm improve the accuracy of the VA national HF dashboard for identifying heart failure subtypes?
Does the inclusion of an imaging-quality hierarchy model and natural-language processing algorithm improve the accuracy of the VA national HF dashboard for identifying heart failure subtypes?
Absolute Event Rate: 89.2% vs 54.1%
The use of natural language processing and an imaging-quality hierarchy model significantly improved the accuracy of a national heart failure dashboard for identifying HF subtypes.
May improve VA HFrEF identification in dashboards; leaves open effects on outcomes and broader implementation.
BACKGROUND: In 2020, the Veterans Affairs (VA) health care system deployed a heart failure (HF) dashboard for use nationally. The initial version was notably imprecise and unreliable for the identification of HF subtypes. We describe the development and subsequent optimization of the VA national HF dashboard. MATERIALS AND METHODS: This study describes the stepwise process for improving the accuracy of the VA national HF dashboard, including defining the initial dashboard, improving case definitions, using natural language processing for patient identification, and incorporating an imaging-quality hierarchy model. Optimization further included evaluating whether to require concurrent ICD-codes for inclusion in the dashboard and assessing various imaging modalities for patient characterization. RESULTS: Through multiple rounds of optimization, the dashboard accuracy (defined as the proportion of true results to the total population) was improved from 54.1% to 89.2% for the identification of HF with reduced ejection fraction (HFrEF) and from 53.9% to 88.0% for the identification of HF with preserved ejection fraction (HFpEF). To align with current guidelines, HF with mildly reduced ejection fraction (HFmrEF) was added to the dashboard output with 88.0% accuracy. CONCLUSIONS: The inclusion of an imaging-quality hierarchy model and natural-language processing algorithm improved the accuracy of the VA national HF dashboard. The revised dashboard informatics algorithm has higher use rates and improved reliability for the health management of the population.
No takes yet. Share an insight, caveat, or question.
Brownell et al. (2023) studied Heart failure. Optimized VA national HF dashboard vs. Initial dashboard was evaluated on Dashboard accuracy for the identification of HFrEF. Optimization of the VA national heart failure dashboard using natural language processing and an imaging-quality hierarchy model improved accuracy for identifying HFrEF from 54.1% to 89.2%.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: