Key result
Most cardiovascular RCTs omit multiplicity corrections for secondary outcomes despite relying on single primary endpoints.
Why the study?
Consensus on best practices for selection, reporting, and interpretation of primary and secondary outcomes in randomized controlled trials is lacking.
This methodological survey of 84 high-impact cardiovascular RCTs highlights widespread inconsistency in secondary outcome multiplicity control and P-value reporting, advocating for a more nuanced interpretation based on the totality of evidence rather than rigid reliance on P<0.05.
Answers are grounded in this paper and cite their sources.
Secondary outcomes often lack multiplicity correction in cardiovascular RCTs; leaves open standardized reporting to improve interpretability.
Consensus as to best practices for the selection, reporting, and interpretation of primary and secondary outcomes of randomized controlled trials is lacking. We reviewed the strategies adopted in publications of randomized controlled trials (RCTs) for the analysis, presentation, and interpretation of efficacy outcomes from a survey of all cardiovascular RCTs published in the New England Journal of Medicine, Lancet, and the Journal of the American Medical Association during 2019. We focus on the choice of primary outcomes, the variety of approaches to selecting secondary outcomes, the options sometimes used to control type I error, and the common practice to not correct for multiple testing in reporting secondary outcomes. We comment on current practice across journals in the reporting of P values and also how conclusions in trial reports frequently adhere to an undue reliance on P < 0.05 as a basis for positive claims of treatment efficacy. We conclude with recommendations for how future RCT reports could best select, report, and interpret their findings on primary and secondary outcomes.
No takes yet. Share an insight, caveat, or question.
Pocock et al. (2021) conducted a review in Cardiovascular diseases in randomized controlled trials (n=84). Outcome selection, statistical multiplicity control, and reporting strategies in cardiovascular RCTs was evaluated on Selection, statistical handling, and interpretation of primary and secondary efficacy outcomes. Among 84 cardiovascular RCTs published in major medical journals in 2019, 89% used a single primary outcome, 75% did not correct for multiplicity in secondary outcomes, and 71% confined conclusions to the primary outcome.
Synapse has enriched 10 related papers. Consider them for comparative context: