Key result
Older ICU mortality prediction models, such as SAPS II, lose calibration over time and tend to overpredict mortality when applied to contemporary patient data.
Answers are grounded in this paper and cite their sources.
Predictive mortality models in the ICU lose calibration over time, leading to over-prediction of mortality and inaccurate benchmarking if applied to contemporary populations.
The authors of a recent paper have described an updated simplified acute physiology score (SAPS) II mortality model developed on patient data from 1998 to 1999. Hospital mortality models have a limited range of applicability. SAPS II, Acute Physiology, Age, and Chronic Health Evaluation (APACHE) III, and mortality probability model (MPM)-II, which were developed in the early 1990s, have shown a decline in predictive accuracy as the models age. The deterioration in accuracy is manifested by a decline in the models' calibration. In particular, mortality tends to get over predicted when older models are applied to more contemporary data, which in turn leads to 'grade inflation' when benchmarking intensive care unit (ICU) performance. Although the authors claim that their updated SAPS II can be used for benchmarking ICU performance, it seems likely that this model might already be out of calibration for patient data collected in 2005 and beyond. Thus, the updated SAPS II model may be interesting for historical purposes, but it is doubtful that it can be an accurate tool for benchmarking data from contemporary populations.
No takes yet. Share an insight, caveat, or question.
Andrew A. Kramer (2005) conducted an editorial in Intensive care unit (ICU) mortality. Older ICU mortality prediction models, such as SAPS II, lose calibration over time and tend to overpredict mortality when applied to contemporary patient data.
Synapse has enriched 10 related papers. Consider them for comparative context: