The NZRISK model, incorporating sex and ethnicity, demonstrated excellent discrimination for 1-month mortality (AUROC 0.921) and calibration, outperforming the SORT model in a New Zealand population.
Observational (n=360,140)
Yes
Does the NZRISK model improve mortality risk prediction compared to SORT in patients undergoing non-cardiac surgery in New Zealand?
The NZRISK model, which includes sex and ethnicity, provides excellent discrimination and calibration for predicting 1-month, 1-year, and 2-year mortality after non-cardiac surgery in a New Zealand population.
Effect estimate: AUROC 0.921
Abstract Background Many multivariable models to calculate mortality risk after surgery are limited by insufficient sample size at development or by application to cohorts distinct from derivation populations. The aims of this study were to validate the Surgical Outcome Risk Tool (SORT) for a New Zealand population and to develop an extended NZRISK model to calculate 1-month, 1-year and 2-year mortality after non-cardiac surgery. Methods Data from the New Zealand National Minimum Data Set for patients having surgery between January 2013 and December 2014 were used to validate SORT. A random 75 per cent split of the data was used to develop the NZRISK model, which was validated in the other 25 per cent of the data set. Results External validation of SORT in the 360 140 patients who underwent surgery in the study period showed good discrimination (area under the receiver operating characteristic curve (AUROC) value of 0·906) but poor calibration (McFadden's pseudo-R2 0·137, calibration slope 5·32), indicating it was invalid in this national surgical population. Internal validation of the NZRISK model, which incorporates sex and ethnicity in addition to the variables used in SORT for 1-month, 1-year and 2-year outcomes, demonstrated excellent discrimination with AUROC values of 0·921, 0·904 and 0·895 respectively, and excellent calibration (McFadden's pseudo-R2 0·275, 0·308 and 0·312 respectively). Calibration slopes were 1·12, 1·02 and 1·02 respectively. Conclusion The SORT performed poorly in this national population. However, inclusion of sex and ethnicity in the NZRISK model improved performance. Calculation of mortality risk beyond 30 days after surgery adds to the utility of this tool for shared decision-making.
Campbell et al. (Tue,) conducted a observational in non-cardiac surgery (n=360,140). NZRISK model vs. Surgical Outcome Risk Tool (SORT) was evaluated on 1-month mortality prediction (AUROC 0.921). The NZRISK model, incorporating sex and ethnicity, demonstrated excellent discrimination for 1-month mortality (AUROC 0.921) and calibration, outperforming the SORT model in a New Zealand population.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: