Why the study?
Does a Bayesian hierarchical model with covariate adjustment improve the assessment of anesthesiologists' performance on mandated metrics compared to frequentist methods?
Does a Bayesian hierarchical model with covariate adjustment improve the assessment of anesthesiologists' performance on mandated metrics compared to frequentist methods?
A Bayesian hierarchical model with covariate adjustment provides a more accurate and fairer assessment of anesthesiologists' performance on mandated metrics than unadjusted frequentist methods.
Answers are grounded in this paper and cite their sources.
Bayesian adjustment may yield fairer anesthesiologist performance assessments than frequentist methods; hypothesis-generating for quality metrics.
AbstractAbstract Noncompliance with simple blood pressure and oxyhemoglobin saturation metrics defined by the Joint Commission in the United States in approximately 70,000 cases at the University of Iowa (Iowa City, Iowa) was present in up to 43 and 70% of anesthesiologists, respectively, using frequentist statistics compared with 2.4 and 0% using a Bayesian approach. Supplemental Digital Content is available in the text. Background: Periodic assessment of performance by anesthesiologists is required by The Joint Commission Ongoing Professional Performance Evaluation program. Methods: The metrics used in this study were the (1) measurement of blood pressure and (2) oxygen saturation (Sp o 2 ) either before or less than 5 min after anesthesia induction. Noncompliance was defined as no measurement within this time interval. The authors assessed the frequency of noncompliance using information from 63,913 cases drawn from the anesthesia information management system. To adjust for differences in patient and procedural characteristics, 135 preoperative variables were analyzed with decision trees. The retained covariate for the blood pressure metric was patient’s age and, for Sp o 2 metric, was American Society of Anesthesiologist’s physical status, whether the patient was coming from an intensive care unit, and whether induction occurred within 5 min of the start of the scheduled workday. A Bayesian hierarchical model, designed to identify anesthesiologists as “performance outliers,” after adjustment for covariates, was developed and was compared with frequentist methods. Results: The global incidences of noncompliance (with frequentist 95% CI) were 5.35% (5.17 to 5.53%) for blood pressure and 1.22% (1.14 to 1.30%) for Sp o 2 metrics. By using unadjusted rates and frequentist statistics, it was found that up to 43% of anesthesiologists would be deemed noncompliant for the blood pressure metric and 70% of anesthesiologists for the Sp o 2 metric. By using Bayesian analyses with covariate adjustment, only 2.44% (1.28 to 3.60%) and 0.00% of the anesthesiologists would be deemed “noncompliant” for blood pressure and Sp o 2 , respectively. Conclusion: Bayesian hierarchical multivariate methodology with covariate adjustment is better suited to faculty monitoring than the nonhierarchical frequentist approach.
No takes yet. Share an insight, caveat, or question.
Bayman et al. (2015) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: