Hypothesis testing and theory evaluation at the boundaries: Surprising insights from Bayes's theorem.

Because the probability of obtaining an experimental finding given that the null hypothesis is true p (F0) is not the same as the probability that the null hypothesis is true given a finding p (H0), calculating the former probability does not justify conclusions about the latter one. As the standard null-hypothesis significance-testing procedure does just that, it is logically invalid (J. Cohen, 1994). Theoretically, Bayes's theorem yields p (H0), but in practice, researchers rarely know the correct values for 2 of the variables in the theorem. Nevertheless, by considering a wide range of possible values for the unknown variables, it is possible to calculate a range of theoretical values for p (H0) and to draw conclusions about both hypothesis testing and theory evaluation.