Prior Information in Frequentist Study Designs: The Case of Neyman’s Sampling Theory

We analyse the issue of using prior information in frequentist statistical inference. For that purpose, we scrutinise different kinds of sampling designs in Jerzy Neyman’s theory to reveal a variety of ways to explicitly and objectively engage with prior information. Further, we turn to the debate on sampling paradigms (design-based vs. model-based approach) to argue that Neyman’s theory provides an argument for the conciliatory approach in the frequentism vs. Bayesianism debate. We also demonstrate that while Neyman’s theory, by allowing non-epistemic values to influence evidence collection and formulation of statistical conclusions, does not compromise the epistemic reliability of the procedures and may improve it. This undermines the value-free ideal of scientific inference