Evaluating a user interface with ergonomic criteria

Projet PSYCHO ERGOThe usefulness of a set of ergonomic criteria for the evaluation of user interfaces was assessed using a mixed two-factors experimental design. Two groups of usability specialists (Control, Criteria) were asked to evaluate the interface of a musical database management system in two phases. In the first phase of the experiment, all the participants relied solely on their expertise; in the second phase they were instructed to evaluate the management system again but this time through the replay of their previous interactions: participants in the Criteria group used a set of ergonomic criteria while the participants in the Control group did not. In the first phase, the two groups did not differ in terms of: (1) the number of usability problems detected, and (2) the proportions of usability problems uncovered as well as the proportion of usability problems found in common, with respect to the size of the aggregates. In the second phase however, the participants in the Criteria group had better performances than those in the Control group: they uncovered more new problems, and the proportion of problems uncovered as well as the proportion of problems found in common was greater as a function of the number of evaluators in the aggregates. To sum up, the criteria increased the evaluation performance of the experts