Observational analysis shows Bayes factors can fluctuate widely in studies, indicating randomness influences outcomes.
You might have seen the ‘Dance of the p -values’ video by Geoff Cumming (if not, watch it here). Because p -values and the default Bayes factors (Rouder, Speckman, Sun, Morey, & Iverson, 2009) are both calculated directly from t -values and sample sizes, we might expect there is also a Dance of the Bayes factors. And indeed, there is. Bayes factors can vary widely over identical studies, just due to random variation.
No takes yet. Share an insight, caveat, or question.
Daniël Lakens (2016) studied this question.
Synapse has enriched 5 closely related papers on similar clinical questions. Consider them for comparative context: