The Problem Solving Genome: Analyzing Sequential Patterns of Student Work with Parametrerized Exercises

ABSTRACT Parameterized exercises have recently emerged as an important tool for online assessment and learning. The ability to generate multiple versions of the same exercise with different parameters helps to support learning-by-doing and decreases cheating during assessment. At the same time, our experience with using parameterized exercises for Java programming reveals suboptimal use of this technology as demonstrated by repeated successful and failed attempts to solve the same problem. In this paper we present the results of our work on modeling and examining patterns of student behavior with parameterized exercises using Problem Solving Genome, a compact encapsulation of individual behavior patterns. We started with micro-patterns (genes) that describe small chunks of repetitive behavior and constructed individual genomes as frequency profiles that shows the dominance of each gene in individual behavior. The exploration of student genomes revealed that individual genome is very stable, distinguishing students from their peers and changing very little with the growth of knowledge over the course. Using the genome, we were able to analyze student behavior on the group level and identify genes associated with good and bad learning performance