Risk prediction models using administrative data predicted in-hospital death with similar discrimination to clinical databases across multiple procedures (e.g., ROC 0.77 vs 0.78 for isolated CABG).
Observational (n=341,379)
Yes
Do risk prediction models based on administrative data perform comparably to those based on clinical databases for predicting in-hospital death in patients undergoing major surgery?
Routinely collected administrative data can predict in-hospital mortality risk with similar discrimination to dedicated clinical databases for major surgical procedures.
OBJECTIVE: To compare risk prediction models for death in hospital based on an administrative database with published results based on data derived from three national clinical databases: the national cardiac surgical database, the national vascular database and the colorectal cancer study. DESIGN: Analysis of inpatient hospital episode statistics. Predictive model developed using multiple logistic regression. SETTING: NHS hospital trusts in England. PATIENTS: All patients admitted to an NHS hospital within England for isolated coronary artery bypass graft (CABG), repair of abdominal aortic aneurysm, and colorectal excision for cancer from 1996-7 to 2003-4. MAIN OUTCOME MEASURES: Deaths in hospital. Performance of models assessed with receiver operating characteristic (ROC) curve scores measuring discrimination (0.8=good) and both Hosmer-Lemeshow statistics and standardised residuals measuring goodness of fit. RESULTS: During the study period 152 523 cases of isolated CABG with 3247 deaths in hospital (2.1%), 12 781 repairs of ruptured abdominal aortic aneurysm (5987 deaths, 46.8%), 31 705 repairs of unruptured abdominal aortic aneurysm (3246 deaths, 10.2%), and 144,370 colorectal resections for cancer (10,424 deaths, 7.2%) were recorded. The power of the complex predictive model was comparable with that of models based on clinical datasets with ROC curve scores of 0.77 (v 0.78 from clinical database) for isolated CABG, 0.66 (v 0.65) and 0.74 (v 0.70) for repairs of ruptured and unruptured abdominal aortic aneurysm, respectively, and 0.80 (v 0.78) for colorectal excision for cancer. Calibration plots generally showed good agreement between observed and predicted mortality. CONCLUSIONS: Routinely collected administrative data can be used to predict risk with similar discrimination to clinical databases. The creative use of such data to adjust for case mix would be useful for monitoring healthcare performance and could usefully complement clinical databases. Further work on other procedures and diagnoses could result in a suite of models for performance adjusted for case mix for a range of specialties and procedures.
Aylin et al. (Mon,) conducted a observational in Isolated CABG, abdominal aortic aneurysm repair, and colorectal excision for cancer (n=341,379). Administrative database risk prediction models vs. Clinical database risk prediction models was evaluated on Deaths in hospital. Risk prediction models using administrative data predicted in-hospital death with similar discrimination to clinical databases across multiple procedures (e.g., ROC 0.77 vs 0.78 for isolated CABG).
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: