Add to ORKGExperimental philosophers use empirical research methods to generate quantitative data, the statistical analysis of which subsequently informs philosophical analyses. These researchers’ philosophical claims thus hinge crucially on their experiments. In this paper I present the results of a pilot study aimed at addressing the question: Does the primary experimental philosophy literature satisfy the most basic demands of experimental design and data analyses? If it does not, then experimental philosophers ’ philosophical claims are void. If it does, then experimental philosophy is on its way to becoming a legitimate discipline and achieving its promise