Key result
Journal checklists are linked to substantially higher preclinical reporting of study design elements like randomization.
Observational (n=4,162)
Answers are grounded in this paper and cite their sources.
Interrupted time-series analysis shows journal reporting checklists significantly improve methodological transparency in preclinical animal studies, highlighting their role in enhancing research...
Background and Purpose— Preclinical research using animals often informs clinical trials. However, its value is dependent on its scientific validity and reproducibility, which are, in turn, dependent on rigorous study design and reporting. In 2011, Stroke introduced a Basic Science Checklist to enhance the reporting and methodology of its preclinical studies. Except for Nature and Science journals, few others have implemented similar initiatives. We sought to estimate the impact of these journal interventions on the quality of their published reports. Methods— All articles published in Stroke , Nature Medicine , and Science Translational Medicine over 9 to 18 years and in 2 control journals without analogous interventions over a corresponding 11.5 years were reviewed to identify reports of experiments in nonhuman mammals with proposed clinical relevance. The effect of journal interventions on the reporting and use of key study design elements was estimated via interrupted time-series analyses. Results— Of 33 009 articles screened, 4162 studies met inclusion criteria. In the 3.5 to 12 years preceding each journal’s intervention, the proportions of studies reporting and using key study design elements were stable except for blinding in Stroke and randomization in Science Translational Medicine , which were both increasing. Post-intervention, abrupt and often marked increases were seen in the reporting of randomization status (level change: +17% to +44%, P ≤0.005), blinding (level change: +20% to +40%, P ≤0.008), and sample size estimation (level change: 0% to +40%, P ≤0.002 in 2 journals). Significant but more modest improvements in the use of these study design elements were also observed. These improvements were not seen in control journals. Conclusions— Journal interventions such as Stroke ’s author submission checklist can meaningfully improve the quality of published preclinical research and should be considered to enhance study transparency and design. However, such interventions are alone insufficient to fully address widespread shortcomings in preclinical research practices.
No takes yet. Share an insight, caveat, or question.
Ramirez et al. (2019) conducted an observational in Preclinical animal research reporting quality (n=4,162). Journal submission checklists and reporting initiatives vs. Control journals without analogous reporting interventions was evaluated on Reporting and use of key study design elements (randomization, blinding, sample size estimation) (Level change +17% to +44% for randomization reporting; +20% to +40% for blinding reporting; 0% to +40% for sample size estimation, p=≤0.005). Journal checklists increased preclinical reporting of randomization and blinding, unlike control journals.
Synapse has enriched 10 related papers. Consider them for comparative context: