Elimination testing with adapted scoring reduces guessing and anxiety in multiple-choice assessments, but does not increase grade average with respect to traditional negative marking

This study is the first to offer an in-depth comparison of elimination testing with the scoring rule of Arnold & Arnold (ETA) and negative marking (NM). As such, this study is part of a search for an alternative for negative marking that still discourages guessing, but is less disadvantageous for non-relevant student characteristics such a risk-aversion and does not result in grade inflation. The comparison is structured around seven Hypotheses: in comparison to NM, ETA leads to (1) a similar average score (no grade inflation); (2) a clear choice of students to express their partial knowledge; (3) a decrease in the number of blank answers; (4) no gender bias in the number of blank answers; (5) a reduction in guessing; (6) a decrease in test anxiety; and finally (7) students prefer ETA over NM. To investigate the above Hypotheses, this study implemented ETA and NM in real exam settings in two courses in a Faculty of Medicine at a large university. Thanks to changes in the master program it occurred that the same two courses were taught to both students of the 1st and 2nd master. Given that both student groups could take the same exam with different test instructions and scoring methods, a unique opportunity occurred where ETA and NM could be compared on real exams. After receiving the grades on the exams, the experiences of students were measured by a questionnaire. The statistical analysis taking into account student ability and gender showed that the scoring method introduced by Arnold and Arnold (ETA) is a valuable alternative for negative marking when looking for a scoring method that discourages guessing. In contrast to traditional scoring of elimination testing, it does not result in grade inflation with respect to NM. This study showed that ETA reduces blank answers and finds strong indications for the reduction of guessing with respect to NM. Finally, students preferred ETA over NM and reported lower stress levels in ETA with respect to NM.status: Published onlin