Evidence‐based sample size calculations based upon updated meta‐analysis

Meta-analyses of randomized controlled trials (RCTs) provide the highest level of evidence regarding the effectiveness of interventions and as such underpin much of evidence-based medicine. Despite this, meta-analyses are usually produced as observational by-products of the existing literature, with no formal consideration of future meta-analyses when individual trials are being designed. Basing the sample size of a new trial on the results of an updated meta-analysis which will include it, may sometimes make more sense than powering the trial in isolation. A framework for sample size calculation for a future RCT based on the results of a meta-analysis of the existing evidence is presented. Both fixed and random effect approaches are explored through an example. Bayesian Markov Chain Monte Carlo simulation modelling is used for the random effects model since it has computational advantages over the classical approach. Several criteria on which to base inference and hence power are considered. The prior expectation of the power is averaged over the prior distribution for the unknown true treatment effect. An extension to the framework allowing for consideration of the design for a series of new trials is also presented. Results suggest that power can be highly dependent on the statistical model used to meta-analyse the data and even very large studies may have little impact on a meta-analysis when there is considerable between study heterogeneity. This raises issues regarding the appropriateness of the use of random effect models when designing and drawing inferences across a series of studies.