Surgeons consistently overpredicted mortality rates and were outperformed by existing risk scoring tools in six of seven studies comparing AUC, though their prediction of general morbidity was good.
Systematic Review (n=20,898)
Does surgeons' perception of risk accurately predict postoperative outcomes compared to risk scoring systems in surgical patients?
Surgeons consistently overestimate mortality risk and are outperformed by risk prediction tools, suggesting these tools should be used to inform clinical decision-making.
BACKGROUND: The accuracy with which surgeons can predict outcomes following surgery has not been explored in a systematic way. The aim of this review was to determine how accurately a surgeon's 'gut feeling' or perception of risk correlates with patient outcomes and available risk scoring systems. METHODS: A systematic review was undertaken in accordance with PRISMA guidelines. A narrative synthesis was performed in accordance with the Guidance on the Conduct of Narrative Synthesis In Systematic Reviews. Studies comparing surgeons' preoperative or postoperative assessment of patient outcomes were included. Studies that made comparisons with risk scoring tools were also included. Outcomes evaluated were postoperative mortality, general and operation-specific morbidity and long-term outcomes. RESULTS: Twenty-seven studies comprising 20 898 patients undergoing general, gastrointestinal, cardiothoracic, orthopaedic, vascular, urology, endocrine and neurosurgical operations were included. Surgeons consistently overpredicted mortality rates and were outperformed by existing risk scoring tools in six of seven studies comparing area under receiver operating characteristic (ROC) curves (AUC). Surgeons' prediction of general morbidity was good, and was equivalent to, or better than, pre-existing risk prediction models. Long-term outcomes were poorly predicted by surgeons, with AUC values ranging from 0·51 to 0·75. Four of five studies found postoperative risk estimates to be more accurate than those made before surgery. CONCLUSION: Surgeons consistently overestimate mortality risk and are outperformed by pre-existing tools; prediction of longer-term outcomes is also poor. Surgeons should consider the use of risk prediction tools when available to inform clinical decision-making.
Dilaver et al. (2019) conducted a systematic review in Patients undergoing surgical operations (n=20,898). Surgeons' perception of risk vs. Existing risk scoring tools was evaluated on Postoperative mortality, general and operation-specific morbidity, and long-term outcomes. Surgeons consistently overpredicted mortality rates and were outperformed by existing risk scoring tools in six of seven studies comparing AUC, though their prediction of general morbidity was good.