Key result
The APACHE II score showed good discrimination (ROC 0.76) but poor calibration (Hosmer-Lemeshow P<0.001) for predicting hospital mortality in a mixed ICU setting.
Why the study?
APACHE II is widely used in Singapore intensive care units to quantify disease severity and hospital mortality risk, but its prognostic validity remains questionable because it has not been thoroughly assessed by established statistical methods.
Does the APACHE II score accurately predict hospital mortality in a mixed ICU population in Singapore?
Cohort (n=503)
No
Does the APACHE II score accurately predict hospital mortality in a mixed ICU population in Singapore?
Effect estimate: ROC 0.76
p-value: p=<0.001
The APACHE II score showed poor calibration for predicting hospital mortality in a Singapore ICU, suggesting it should not be used locally without further customization.
APACHE II may need local recalibration in Singapore ICUs; leaves open whether customized models improve mortality prediction.
Background: The Acute Physiology and Chronic Health Evaluation II (APACHE II) is used to quantify disease severity and hospital mortality risk in critically ill patients. It is widely used in intensive care units (ICUs) in Singapore, but its prognostic validity remains questionable as it has not been thoroughly assessed by established statistical methods. Objectives: This study aimed to: (a) evaluate the discrimination and calibration accuracy of the APACHE II in the prediction of hospital mortality in a mixed ICU, and (b) customise the APACHE II in an effort to maximise its prognostic performance. Methods: A prospective cohort study was conducted and all adult patients with >24 h of ICU admission in a tertiary care institution in Singapore were included. The outcome measure was hospital mortality, and all patients were followed-up until hospital discharge or death for up to one year after ICU admission. Results: There were 503 patients, and their mean (SD) age and APACHE II score were 61.2 (15.8) years and 24.5 (8.2), respectively. Hospital mortality was 31%, and no patients were lost to follow-up. The APACHE II has good discrimination (receiver operating characteristic: 0.76) but poor calibration (Hosmer–Lemeshow C test: <0.001). Customisation did not significantly improve calibration accuracy. Conclusions: The APACHE II and its customised version should not be used in the local setting as they both have poor calibration. There is an urgent need for larger studies to perform second-level customisation or to develop a new prognostic model tailored to the Singapore critical care setting.
No takes yet. Share an insight, caveat, or question.
Lew et al. (2018) conducted a cohort in Critically ill patients (n=503). APACHE II score was evaluated on Hospital mortality (ROC 0.76, p=<0.001). The APACHE II score showed good discrimination (ROC 0.76) but poor calibration (Hosmer-Lemeshow P<0.001) for predicting hospital mortality in a mixed ICU setting.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: