Empirical Software Engineering manuscript No. (will be inserted by the editor) Measuring and Modeling Programming Experience

Abstract Programming experience is an important confounding parameter in controlled experiments regarding program comprehension. In literature, ways to measure or control programming experience vary. Often, researchers neglect it or do not specify how they controlled for it. We set out to find a well-defined understanding of programming experience and a way to measure it. From published comprehension experiments, we extracted questions that assess pro-gramming experience. In a controlled experiment, we compare the answers of computer-science students to these questions with their performance in solv-ing program-comprehension tasks. We found that self estimation seems to be a reliable way to measure programming experience. Furthermore, we applied ex-ploratory and confirmatory factor analyses to extract and evaluate a model of programming experience. With our analysis, we initiate a path toward validly and reliably measuring and describing programming experience to better un-derstand and control its influence in program-comprehension experiments.