Answers are grounded in this paper and cite their sources.
A detailed presentation of hypothesis testing is given. The "look elsewhere" effect is illustrated, and a treatment of the trials factor is proposed with the introduction of hypothesis hypertests. An example of such a hypertest is presented, named BumpHunter, which is used in the recent ATLAS dijet resonance search, and in an earlier version in the CDF Global Search, to look for exotic phenomena in high energy physics. As a demonstration, the BumpHunter is used to address Problem 1 of the Banff Challenge.
No takes yet. Share an insight, caveat, or question.
G. Choudalakis (2011) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: