Gesture recognition with a wii controller

In many applications today user interaction is moving away from mouse and pens and is becoming pervasive and much more physical and tangible. New emerging interaction tech-nologies allow developing and experimenting with new in-teraction methods on the long way to providing intuitive hu-man computer interaction. In this paper, we aim at recogni-zing gestures to interact with an application and present the design and evaluation of our sensor-based gesture recogniti-on. As input device we employ the Wii-controller (Wiimo-te) which recently gained much attention world wide. We use the Wiimote’s acceleration sensor independent of the ga-ming console for gesture recognition. The system allows the training of arbitrary gestures by users which can then be re-called for interacting with systems like photo browsing on a home TV. The developed library exploits Wii-sensor data and employs a hidden Markov model for training and reco-gnizing user-chosen gestures. Our evaluation shows that we can already recognize gestures with a small number of trai-ning samples. In addition to the gesture recognition we also present our experiences with the Wii-controller and the im-plementation of the gesture recognition. The system forms the basis for our ongoing work on multimodal intuitive me-dia browsing and is available to other researchers in the field. Author Keywords tangible user interfaces, gesture recognition, Wiimot