Electrotechnical Review: Ljubljana, Slovenija Evaluation of a multimodal interaction concept in virtual worlds

Abstract. In the presented paper we address the issue of multimodal interaction concept in virtual worlds. The topics of multimodal interaction and virtual worlds are presented in general. We present and apply a multimodal approach consisting of voice commands, motion and gesture based modalities to a Second Life virtual world. Detailed description of key pilot system elements and architecture is given. The proposed multimodal approach was tested both objectively and subjectively by the evaluation study. The study results show that the addition of voice and alternative navigation modalities significantly improve overall user experience