Key result
A machine learning algorithm achieved 88.7% accuracy in predicting consensus triage categories for heart failure exacerbations, outperforming the top individual physician's accuracy of 82.5%.
Why the study?
Most current at-home HF management protocols lack rigor and validation at the level of the individual patient, contributing to over 1 million HF-related US hospitalizations.
Does a machine learning triage algorithm improve classification accuracy of heart failure exacerbations compared to individual physician assessment in simulated patient scenarios?
Does a machine learning triage algorithm improve classification accuracy of heart failure exacerbations compared to individual physician assessment in simulated patient scenarios?
A machine learning algorithm trained on simulated patient vignettes can identify and triage heart failure exacerbations with higher accuracy than individual physicians when compared to a consensus standard.
Suggests ML may exceed individual accuracy for simulated HF triage; leaves open real-world validation before practice change.
Inadequate at-home management and self-awareness of heart failure (HF) exacerbations are known to be leading causes of the greater than 1 million estimated HF-related hospitalizations in the USA alone. Most current at-home HF management protocols include paper guidelines or exploratory health applications that lack rigor and validation at the level of the individual patient. We report on a novel triage methodology that uses machine learning predictions for real-time detection and assessment of exacerbations. Medical specialist opinions on statistically and clinically comprehensive, simulated patient cases were used to train and validate prediction algorithms. Model performance was assessed by comparison to physician panel consensus in a representative, out-of-sample validation set of 100 vignettes. Algorithm prediction accuracy and safety indicators surpassed all individual specialists in identifying consensus opinion on existence/severity of exacerbations and appropriate treatment response. The algorithms also scored the highest sensitivity, specificity, and PPV when assessing the need for emergency care. Here we develop a machine-learning approach for providing real-time decision support to adults diagnosed with congestive heart failure. The algorithm achieves higher exacerbation and triage classification performance than any individual physician when compared to physician consensus opinion.
No takes yet. Share an insight, caveat, or question.
Morrill et al. (2021) studied Heart failure (n=1,900). Machine learning triage algorithm vs. Individual physician triage recommendations was evaluated on Accuracy in predicting consensus triage category. A machine learning algorithm achieved 88.7% accuracy in predicting consensus triage categories for heart failure exacerbations, outperforming the top individual physician's accuracy of 82.5%.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: