PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
December 21, 2025The Review of Economics and Statistics1 citations

The Power of Tests for Detecting p -Hacking

View Full Paper
GEGraham ElliottNKNikolay KudrinKWKaspar Wüthrich

Key Points

  • This research aims to analyze the power of methods for detecting p-hacking by studying its implications on p-value distributions.
  • Theoretical investigation of p-hacking implications on p-value distributions
  • Examination of various p-hacking strategies and true effect distributions
  • Assessment of combined tests for upper bounds, monotonicity, and p-curve continuity.
  • Power of tests for detecting p-hacking is often low and varies by strategy
  • Combined tests for upper bounds and monotonicity have higher detection power
  • Tests for continuity of the p-curve tend to show high power for identifying p-hacking.

Abstract

Abstract A flourishing empirical literature investigates the prevalence of p-hacking based on the distribution of p-values across studies. Interpreting results in this literature requires a careful understanding of the power of methods for detecting p-hacking. We theoretically study the implications of likely forms of p-hacking on the distribution of p-values to understand the power of tests for detecting it. Power can be low and depends crucially on the p-hacking strategy and the distribution of true effects. Combined tests for upper bounds and monotonicity and tests for continuity of the p-curve tend to have the highest power for detecting p-hacking.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Elliott et al. (2025) studied this question.

synapsesocial.com/papers/69473b64db9c958d0dfca828https://doi.org/10.1162/rest.a.1688
Ask AI
Helpful
Bookmark
Share
View Full Paper