Grading in Chemistry: Variations in Instructors' Evaluation of Student Written Responses

Evaluation of student written work during summative assessments is an important and critical task for instructors at all educational levels. Nevertheless, few research studies exist that provide insights into how different instructors approach this task. Chemistry faculty (FIs) and graduate student instructors (GSIs) regularly engage in the evaluation and grading of student written responses in formal formative and summative assessments. In this study, we characterized how different instructors teaching general chemistry at the University of Arizona differed in their approaches to the evaluation and grading of students’ written answers in midterm exams. This work is critical to support the professional development of instructors to ensure a fair evaluation of all students.In the first part of this project, we identified and characterized dimensions of variation in general chemistry instructors' approaches to the evaluation and grading of a conceptual question. Using qualitative methods of research, we conducted individual interviews in which participating chemistry FIs and GSIs were asked to evaluate and grade the same set of students' responses to a typical exam prompt and justify their decisions. Our results showed that observed variability in assigned grades emerged from the complex interaction of explicit and implicit decisions made and preferences manifested along various dimensions. Based on this characterization, we developed an analytical framework to characterize variation in the evaluation approaches of chemistry instructors when grading free response questions In the second stage of this project, we applied the analytical framework to characterize variation in the evaluation and grading of a diverse set of open response questions and to analyze the impact of such variations on assigned grades. Our results revealed a wide variation in the approaches followed by instructors along different dimensions, although most instructors tended to be consistent in the approaches they individually followed when analyzing different student responses to diverse questions. Instructors’ experience seemed to impact assigned grades but relevant dimensions of variation in the evaluation differed for less and more experienced instructors