Declaration

The increasing ubiquity of three dimensional output devices suggests a need for three dimensional input devices. A human computer interactive system, entitled Wii3D, was developed to attempt to fill this need. The Wii3D System uses two Nintendo Wii Remotes to track the movement of infra-red lights, attached to the fingers of a user, in each of the camera's viewports. Stereoscopic triangulation is used to resolve the points in three dimensional space. Further tracking in three dimensions is achieved using predictive interpolation. A framework was designed and implemented to enable the recognition of predefined gestures using Finite State Automata and Discrete Hidden Markov Models. The aforementioned tracking data was processed by the gesture recognition module and raised the relevant events when a gesture was recognized. A user study was undertaken in order to investigate the usefulness of the Wii3D System and the general intuitiveness of the proposed interface and gestures when compared with the standard mouse and keyboard interaction technique. The Wii3D System was found to be more intuitive for multitouch applications, but was not as intuitive as the mouse and keyboard for single pointer applications, even though the proposed interaction technique was found adequate for the majority of the gestures implemented