Key result
Quality improvement collaborative fails to improve pre-hospital care trends for AMI or stroke.
Why the study?
Interrupted time series designs require appropriate analysis methods such as segmented regression to accurately evaluate intervention effects, but standard regression is often used instead.
Odds Ratio: 1.04 (95% CI 0.98–1.1)
p-value: p=0.20
Segmented regression analysis is the recommended statistical approach for analyzing data from interrupted time series studies, particularly for evaluating complex quality improvement interventions.
No support for adopting this quality improvement collaborative in pre-hospital AMI or stroke care; leaves open the effectiveness of implementation strategies.
BACKGROUND: An interrupted time series design is a powerful quasi-experimental approach for evaluating effects of interventions introduced at a specific point in time. To utilize the strength of this design, a modification to standard regression analysis, such as segmented regression, is required. In segmented regression analysis, the change in intercept and/or slope from pre- to post-intervention is estimated and used to test causal hypotheses about the intervention. We illustrate segmented regression using data from a previously published study that evaluated the effectiveness of a collaborative intervention to improve quality in pre-hospital ambulance care for acute myocardial infarction (AMI) and stroke. In the original analysis, a standard regression model was used with time as a continuous variable. We contrast the results from this standard regression analysis with those from segmented regression analysis. We discuss the limitations of the former and advantages of the latter, as well as the challenges of using segmented regression in analysing complex quality improvement interventions. FINDINGS: Based on the estimated change in intercept and slope from pre- to post-intervention using segmented regression, we found insufficient evidence of a statistically significant effect on quality of care for stroke, although potential clinically important effects for AMI cannot be ruled out. CONCLUSIONS: Segmented regression analysis is the recommended approach for analysing data from an interrupted time series study. Several modifications to the basic segmented regression analysis approach are available to deal with challenges arising in the evaluation of complex quality improvement interventions.
No takes yet. Share an insight, caveat, or question.
Taljaard et al. (2014) studied Acute myocardial infarction (AMI) and stroke. Collaborative intervention to improve quality in pre-hospital ambulance care vs. Pre-intervention secular trend was evaluated on Percentage of patients with a pre-hospital diagnosis of AMI who received a defined care bundle (change in slope from pre- to post-intervention) (OR 1.04, 95% CI 0.98 to 1.10, p=0.20). Re-analysis using segmented regression demonstrated that a quality improvement collaborative did not significantly improve pre-hospital care trends for acute myocardial infarction (OR 1.04 per month; 95% CI 0.98 to 1.10) or stroke.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: