AWii-based gestural interface for computer conducting systems

With the increase of sales of Wii game consoles, it is be-coming commonplace for the Wii remote to be used as an alternative input device for other computer systems. In this paper, we present a system which makes use of the infrared camera within the Wii remote to capture the gestures of a conductor using a baton with an infrared LED and battery. Our system then performs data analysis with gesture classi-fication and following, and finally displays the gestures us-ing visual baton trajectories and audio feedback. Gesture trajectories are displayed in real time and can be compared to the corresponding diagram shown in a textbook. In addi-tion, since a conductor normally does not look at a screen while conducting, tones are played to represent a certain beat in a conducting gesture. Further, the system can be con-trolled entirely with the baton, removing the need to switch from baton to mouse. The interface is intended to be used for pedagogy purposes