Comparison of a phased experimental approach and a single randomized clinical trial for developing multicomponent behavioral interventions

BACKGROUND: Many interventions in today's health sciences are multicomponent, and often one or more of the components are behavioral. Two approaches to building behavioral interventions empirically can be identified. The more typically used approach, labeled here the classical approach, consists of constructing a likely best intervention a priori, and then evaluating the intervention in a standard randomized controlled trial (RCT). By contrast, the emergent phased experimental approach involves programmatic phases of empirical research and discovery aimed at identifying individual intervention component effects and the best combination of components and levels. PURPOSE: The purpose of this article is to provide a head-to-head comparison between the classical and phased experimental approaches and thereby highlight the relative advantages and disadvantages of these approaches when they are used to select program components and levels so as to arrive at the most potent intervention. METHODS: A computer simulation was performed in which the classical and phased experimental approaches to intervention development were applied to the same randomly generated data. RESULTS: The phased experimental approach resulted in better mean intervention outcomes when the intervention effect size was medium or large, whereas the classical approach resulted in better mean intervention outcomes when the effect size was small. The phased experimental approach led to identification of the correct set of intervention components and levels at a higher rate than the classical approach across all conditions. LIMITATIONS: Some potentially important factors were not varied in the simulation, for example the underlying structural model and the number of intervention components. CONCLUSIONS: The phased experimental approach merits serious consideration, because it has the potential to enable intervention scientists to develop more efficacious behavioral interventions.