Key result
Evaluation of 22 clinical risk calculators for hospital admission revealed that only 1/22 met standards for reproducibility and 1/22 for measurement of effect on clinical use.
Why the study?
Clinical prediction and decision tools are prevalent, but their appropriate use and validity, particularly for guiding complex hospitalization decisions, remain unclear.
Systematic Review (n=22)
Clinical risk calculators used for hospital admission decisions often lack rigorous methodologic validation and fail to report key population details like race/ethnicity and social determinants of health.
Answers are grounded in this paper and cite their sources.
Most admission risk calculators lack validation; challenges routine use and extends need for prospective testing before adoption.
INTRODUCTION: Clinical prediction and decision tools that generate outcome-based risk stratification and/or intervention recommendations are prevalent. Appropriate use and validity of these tools, especially those that inform complex clinical decisions, remains unclear. The objective of this study was to assess the methodologic quality and applicability of clinical risk scoring tools used to guide hospitalization decision-making. METHODS: In February 2021, a comprehensive search was performed of a clinical calculator online database (mdcalc.com) that is publicly available and well-known to clinicians. The primary reference for any calculator tool informing outpatient versus inpatient disposition was considered for inclusion. Studies were restricted to the adult, acute care population. Those focused on obstetrics/gynecology or critical care admission were excluded. The Wasson-Laupacis framework of methodologic standards for clinical prediction rules was applied to each study. RESULTS: A total of 22 calculators provided hospital admission recommendations for 9 discrete medical conditions using adverse events (14/22), mortality (6/22), or confirmatory diagnosis (2/22) as outcomes of interest. The most commonly met methodologic standards included mathematical technique description (22/22) and clinical sensibility (22/22) and least commonly met included reproducibility of the rule (1/22) and measurement of effect on clinical use (1/22). Description of the studied population was often lacking, especially patient race/ethnicity (2/22) and mental or behavioral health (0/22). Only one study reported any item related to social determinants of health. CONCLUSION: Studies commonly do not meet rigorous methodologic standards and often fail to report pertinent details that would guide applicability. These clinical tools focus primarily on specific disease entities and clinical variables, missing the breadth of information necessary to make a disposition determination and raise significant validation and generalizability concerns.
No takes yet. Share an insight, caveat, or question.
Soleimanpour et al. (2022) conducted a systematic review in Hospital admission decision-making (n=22). Clinical risk calculators was evaluated on Methodologic quality based on the Wasson-Laupacis framework. Evaluation of 22 clinical risk calculators for hospital admission revealed that only 1/22 met standards for reproducibility and 1/22 for measurement of effect on clinical use.
Synapse has enriched 10 related papers. Consider them for comparative context: