Microsoft Speech Recognition As A New Way Of Communication In Augmented Reality Environment

The advancement of technology in computers has given rise to more sophisticated and smarter computers. This has spurred on the birth of Augmented Reality (AR) technology. AR enables users to view virtual 3D model in the real world environment in real-time. Mostly, we depend on traditional input devices such as the keyboard, mouse or joystick to interact within the AR environment. Thus, it is crucial to come out with sophisticated type way of communication to suit the current technology. Speech Recognition (SR) can be used to replace traditional input devices. SR enables users to communicate within the AR environment by using spoken words. SR was integrated in the AR environment as a way of communication. Microsoft Speech SDK 5.1 is used to build the necessary SR to be integrated in the AR environment. Users can continuously speak with the computer to execute certain control or commands. 3D models are created and rendered in a Virtual Reality (VR) environment to correspond with the input given. Furthermore, an evaluation was conducted to test the system functionality of SR for interaction with the virtual object in AR system. The result of the evaluation reinforces the potential of SR as a command and control in the AR system