Answers are grounded in this paper and cite their sources.
We show that if among the tested hypotheses the number of true hypotheses is not equal to the number of false hypotheses, then Neyman-Pearson theory of testing hypotheses does not warrant minimal epistemic reliability (the feature of driving to true conclusions more often than to false ones). We also argue that N-P does not protect from the possible negative effects of the pragmatic value-laden unequal setting of error probabilities on N-P’s epistemic reliability. Most importantly, we argue that in the case of a negative impact no methodological adjustment is available to neutralize it, so in such cases the discussed pragmatic-value-ladenness of N-P inevitably compromises the goal of attaining truth.
No takes yet. Share an insight, caveat, or question.
Kubiak et al. (2021) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: