A Methodological Plea: Sampling in Experimental Philosophy

This paper highlights a methodological problem that might render the value of Experimental Philosophy (X‐Phi) research unclear. It is argued that research in X‐Phi often relies on an unrepresentative sample with respect to the target population and the contingent property examined. In these cases, the results are valid—at best—for a subset of the target population, but sometimes it is even difficult to determine to which subset the results apply. After illustrating this problem using an assortment of examples, the paper advances a framework for dealing with it. Finally, the paper reflects on the problem from a metaphilosophical perspective, suggesting that the scientific ethos of analytic philosophy has led to extraordinary enthusiasm surrounding the adoption of scientific methods, but as a result, the rapid adoption of these methods has often led to premature application.