Examining how changes in policy affect p-hacking and publication bias, using a diff-in-diff analysis.
In mid-2016, all journals of the American Economic Association (AEA) stopped including significance stars in their regression tables. This policy aimed to reduce the emphasis on statistical significance and shift the focus to the broader economic importance of research findings. This study examines the impact of this change on p-hacking and publication bias. I employ a diff-in-diff design, as well as the battery of tests proposed by Elliott et al. (2022b). I find no statistically significant effect of this policy.
No takes yet. Share an insight, caveat, or question.
Costanza Naguib (2025) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: