Key result
Preoperative surgeon intuition underperforms the ACS NSQIP calculator in predicting 30-day postoperative complications.
Why the study?
Surgeon assessment may capture risk factors for postoperative complications that traditional clinical risk prediction models do not, but its predictive utility compared to established models is unclear.
Does preoperative surgeon intuition predict postoperative complications better than the ACS NSQIP risk calculator in general surgery patients?
Observational (n=9,182)
Does preoperative surgeon intuition predict postoperative complications better than the ACS NSQIP risk calculator in general surgery patients?
Preoperative surgeon intuition is an independent predictor of postoperative outcomes, but the ACS NSQIP risk calculator is a more robust predictor, and combining them does not improve prediction.
Answers are grounded in this paper and cite their sources.
Supports prioritizing NSQIP calculator over intuition for risk assessment; leaves open value of combined models in prospective cohorts.
BACKGROUND: Surgical risk prediction models traditionally use patient attributes and measures of physiology to generate predictions about postoperative outcomes. However, the surgeon's assessment of the patient may be a valuable predictor, given the surgeon's ability to detect and incorporate factors that existing models cannot capture. We compare the predictive utility of surgeon intuition and a risk calculator derived from the American College of Surgeons (ACS) NSQIP. STUDY DESIGN: From January 10, 2021 to January 9, 2022, surgeons were surveyed immediately before performing surgery to assess their perception of a patient's risk of developing any postoperative complication. Clinical data were abstracted from ACS NSQIP. Both sources of data were independently used to build models to predict the likelihood of a patient experiencing any 30-day postoperative complication as defined by ACS NSQIP. RESULTS: Preoperative surgeon assessment was obtained for 216 patients. NSQIP data were available for 9,182 patients who underwent general surgery (January 1, 2017 to January 9, 2022). A binomial regression model trained on clinical data alone had an area under the receiver operating characteristic curve (AUC) of 0.83 (95% CI 0.80 to 0.85) in predicting any complication. A model trained on only preoperative surgeon intuition had an AUC of 0.70 (95% CI 0.63 to 0.78). A model trained on surgeon intuition and a subset of clinical predictors had an AUC of 0.83 (95% CI 0.77 to 0.89). CONCLUSIONS: Preoperative surgeon intuition alone is an independent predictor of patient outcomes; however, a risk calculator derived from ACS NSQIP is a more robust predictor of postoperative complication. Combining intuition and clinical data did not strengthen prediction.
No takes yet. Share an insight, caveat, or question.
Marwaha et al. (2023) conducted an observational in General surgery (n=9,182). Preoperative surgeon intuition vs. ACS NSQIP clinical risk calculator was evaluated on Any 30-day postoperative complication (AUC 0.70, 95% CI 0.63-0.78). Preoperative surgeon intuition predicted 30-day postoperative complications with an AUC of 0.70, whereas the ACS NSQIP clinical risk calculator achieved an AUC of 0.83.
Synapse has enriched 10 related papers. Consider them for comparative context: