Tangible interfaces for navigation in virtual environments: a Argonauta Reactor case study

This work presents a interaction system for virtual environments that allows users control platform without the need of using mouse and keyboard. Through the head movement and voice commands is possible the navigation and control of virtual human (avatar), thus, better human-computer integration. The control system called SOMI (Sounds and Motion Interface) is based on speech recognition using artificial neural networks (ANN), where once the ANN are trained for the different users it possible direct a vocal command to a command of avatar, resulting in the possibility of control by voice. Head movements are recognised using the system infrared(IR) head tracking, this system is based in a IR camera detecting the position of IR leds positioned on the user's head to put the avatar vision in accordance with the vision of the user. The SOMI was integrated into a system called Virtual Argonauta (VA), this system configures itself as a virtual platform for operations training at nuclear reactor research of the Nuclear Engineering Institute (IEN/CNEN), until the present work the virtual person was all controlled by mouse and keyboard, preventing the use of head mounted display (HMD) and decreasing user immersion. The results show an interface that promotes a more effective and engaging manner allowing the use of HMD and with that greater immersion of human beings to the virtual environment, more specifically the VA environment