Answers are grounded in this paper and cite their sources.
Open data allows researchers to explore pre-existing datasets in new ways. However, if many researchers reuse the same dataset, multiple statistical testing may increase false positives. Here we demonstrate that sequential hypothesis testing on the same dataset by multiple researchers can inflate error rates. We go on to discuss a number of correction procedures that can reduce the number of false positives, and the challenges associated with these correction procedures.
No takes yet. Share an insight, caveat, or question.
Thompson et al. (2020) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: