Continuous monitoring of case-mix adjusted mortality using a cumulative risk chart detected adverse trends that crossed 99% control limits, which were missed by annual monitoring.
Observational (n=3,983)
No
Continuous monitoring of cumulative risk-adjusted mortality is superior to annual league tables for detecting true changes in surgical performance.
Effect estimate: OR 1-1.5
p-value: p=0.18
Abstract Objective: To detect changes in mortality after surgery, with allowance being made for variations in case mix. Design: Observational study of postoperative mortality from January 1992 to August 1995. Setting: Regional cardiothoracic unit. Subjects: 3983 patients aged 16 and over who had open heart operations. Main outcome measures : Preoperative risk factors and postoperative mortality in hospital within 30 days were recorded for all surgical heart operations. Mortality was adjusted for case mix using a preoperative estimate of risk based on additive Parsonnet factors. The number of operations required for statistical power to detect a doubling of mortality was examined, and control limits at a nominal significance level of P=0.01 for detection of an adverse trend were determined. Results: Total mortality of 7.0% was 26% below the Parsonnet predictor (P<0.0001). There was a highly significant variation in annual case mix (Parsonnet scores 8.7-10.6, P<0.0001). There was no significant variation in mortality after adjustment for case mix (odds ratio 1-1.5, P=0.18) with monitoring by calendar year. With continuous monitoring, however, nominal 99% control limits based on 16 expected deaths were crossed on two occasions. Conclusions: Hospital league tables for mortality from heart surgery will be of limited value because year to year differences in death rate can be large (odds ratio 1.5) even when the underlying risk or case mix does not change. Statistical quality control of a single series with adjustment for case mix is the only way to take into account recent performance when informing a patient of the risk of surgery at a particular hospital. If there is an increase in the number of deaths the chances of the next patient surviving surgery can be calculated from the last 16 deaths. Key messages Changes in the patient population affect a hospital's annual death rate Year to year differences in death rate can be large even when there is no change in the underlying risk or case mix It takes surprisingly many operations before an increase in death rate can be distinguished from random fluctuation A formal inquiry should take place in a hospital if the death rate rises above control limits The chances of the next patient surviving surgery should be calculated using the surgeon's most recent results
Poloniecki et al. (Sat,) conducted a observational in Open heart operations (n=3,983). Continuous monitoring of case-mix adjusted mortality vs. Monitoring by calendar year was evaluated on Postoperative mortality in hospital within 30 days (OR 1-1.5, p=0.18). Continuous monitoring of case-mix adjusted mortality using a cumulative risk chart detected adverse trends that crossed 99% control limits, which were missed by annual monitoring.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: