A CatBoost model incorporating intraoperative variables accurately predicted postoperative pulmonary complications, achieving an AUROC of 0.865 during external validation.
Observational (n=1,283)
Yes
Does a machine learning model incorporating intraoperative data improve the prediction of postoperative pulmonary complications compared to preoperative models alone in non-cardiothoracic surgical patients?
Incorporating intraoperative data into a machine learning model significantly improves the prediction of postoperative pulmonary complications compared to using preoperative variables alone.
Absolute Event Rate: 0.865% vs 0.827%
Background Most existing models for predicting postoperative pulmonary complications (PPCs) rely solely on preoperative variables and lack integration of intraoperative data or clinical tools for application. Methods This study developed and externally validated logistic regression and machine learning (ML) models for predicting PPCs in non-cardiothoracic surgical patients undergoing general anesthesia. A cohort of 997 patients was randomly divided into training and test sets in a 7:3 ratio. The stepwise regression method was adopted to conduct feature screening on the preoperative dataset and the combined preoperative and intraoperative dataset, and a variety of ML algorithm models were developed. Model performance was evaluated using area under the receiver operating characteristic (AUROC), area under the precision-recall curve (AUPRC), brier score, sensitivity, specificity, precision, and F1-score. External validation was performed on an independent cohort of 286 patients from a different institution. The features of the optimized model were interpreted by introducing SHapley Additive exPlanations (SHAP) method. Results The AUROC value of the logistic regression model using only preoperative variables in the test set was 0.828. After including intraoperative variables, the CatBoost model demonstrated superior performance, with an AUROC value of 0.927. In the preoperative model, C-reactive protein (CRP), American Society of Anesthesiologists (ASA) physical status classification, age, and smoking status were the most significant predictors. However, operative duration, CRP, age, and intraoperative blood loss were the dominant predictors of postoperative outcomes. External validation confirmed general applicability, with preoperative logistic regression and the Assess Respiratory Risk in Surgical Patients in Catalonia Tool (ARISCAT) yielding AUROC values of 0.827 and 0.796, respectively. The postoperative CatBoost model achieved an AUROC of 0.865, AUPRC of 0.809, sensitivity of 0.787, specificity of 0.921, and the lowest Brier score (0.132). Conclusions The preoperative model enabled early risk stratification, while the postoperative model provided improved accuracy. A publicly accessible web-based calculator was developed to support clinical implementation and facilitate prospective validation.
Dai et al. (2026) conducted an observational in Postoperative pulmonary complications (n=1,283). CatBoost machine learning model incorporating intraoperative variables vs. Preoperative logistic regression model was evaluated on Prediction of postoperative pulmonary complications (AUROC). A CatBoost model incorporating intraoperative variables accurately predicted postoperative pulmonary complications, achieving an AUROC of 0.865 during external validation.