Inaccuracy of four coronary surgery risk-adjusted models to predict mortality in individual patients

OBJECTIVES: This study was undertaken to evaluate the accuracy of four different risk-adjusted models in predicting mortality in individual patients who are undergoing coronary artery by-pass graft surgery. In the last decade several models to stratify patients before open heart surgery, according to factors affecting mortality, were developed with the aim of retrospectively comparing outcomes of open heart surgery, based on reliable stratification of case-mix, and of prospectively identifying high risk patients as a basis for a meaningful informed consent for patients counseling. METHODS: The pre-operative risk of death was calculated with four different models in 418 consecutive patients who underwent coronary artery by-pass surgery and then compared with the actual outcome. To discriminate patients with favorable and unfavorable outcome, the logistic regression analysis and the areas under the receiver-operating-characteristic curves were applied. The accuracy score was used to evaluate the reliability of each score to predict the individual outcome. RESULTS: Seven deaths (1.7%) were observed within 30 days from the operation, and the overall incidence was similar to that predicted by all models. Only the NBI score was not able to discriminate survivors from patients who will die, and the areas under the curves were 0.596 for the Parsonnet score, 0.861 for the Cleveland Clinic Foundation score, 0.823 for the French score, and 0.806 for the EuroSCORE. The four models were highly accurate (between 0.97 and 0.98) to predict the overall mortality. In seven patients who died the mean predictive scores were very low and ranged between 2.1 and 4.6, but were significantly higher than those of patients who survived (between 1.1 and 2.2). CONCLUSIONS: The four pre-surgical predictive models were similarly able to discriminate favorable vs. unfavorable outcomes and highly accurate to predict overall mortality, but very inaccurate to predict mortality in individual patients.