Single-arm Trials with Historical Controls

BACKGROUND: Regulatory agencies now recognize single-arm trials with external historical controls, particularly common in oncology, to assess promising treatments for rare or specific indications. When a new treatment indication depends on events over time, such as treatment failures, this design can introduce time-related biases in comparisons with external controls. METHODS: We describe two potential biases resulting from calendar time and choice of time zero. We illustrate these biases using simulated data, emulating those from a single-arm trial of the effectiveness of blinatumomab in treating relapsed or refractory acute lymphoblastic leukemia on the outcome of mortality. RESULTS: The trial compared 189 patients treated with blinatumomab with 1112 external historical control patients. First, calendar time was not concurrent, with the blinatumomab arm diagnosed during 2010-2014 and the control cohort during 1990-2013. The median survival under blinatumomab was 6.1 months compared with 3.3 months in the control arm, though for the latter it increased from 2.4 to 4.2 months over the 24-year period. Second, using the latest line of salvage treatment as cohort, entry for the control cohort introduces selection bias. The corresponding hazard ratio of death with blinatumomab compared with control was 0.56 (95% CI = 0.47, 0.67) but became 0.98 (95% CI = 0.83, 1.15) after redefining cohort entry by the matched line of salvage treatment rather than the latest line. CONCLUSION: While single-arm trials with external historical controls are gaining recognition, a proper understanding of time-related sources of bias is essential if such trials will be used to provide valid evidence for drug approval from regulatory agencies.