Performance evaluation of adaptive content selection in AEHS

Adaptive content selection is recognized as a challenging research issue in adaptive educational hypermedia systems (AEHS). Several efforts have been reported in literature aiming to support the Adaptation Model (AM) design by providing AEHS designers with either guidance for the direct definition of adaptation rules, or semi-automated mechanisms which generate the AM via the implicit definition of such rules. The goal of the semi-automated, decision-based approaches is to generate a continuous decision function that estimates the desired AEHS response, aiming to overcome the insufficiency and/or inconsistency problems of the defined adaptation rule sets. Although such approaches bare the potential to provide efficient AMs, they still miss a commonly accepted framework for evaluating their performance. In this paper, we propose an evaluation framework suitable for validating the performance decision-based approaches in adaptive learning objects selection in AEHS and demonstrate the use of this framework in the case of our proposed decision-based approach for estimating the desired AEHS response. © Springer-Verlag Berlin Heidelberg 2011