PHYSIOSONIC- MOVEMENT SONIFICATION AS AUDITORY FEEDBACK

We detect human body movement interactively via a tracking sys-tem. This data is used to synthesize sound and transform sound files (music or text). A subject triggers and controls sound param-eters with his or her movement within a pre-set range of motion. The resulting acoustic feedback enhances new modalities of per-ception and the awareness of the body movements. It is ideal for application in physiotherapy and other training contexts. The sounds we use depend on the context and aesthetic pref-erences of the subject. On the one hand, metaphorical sounds are used to indicate the leaving of the range of motion or to make un-intended movements aware. On the other hand, sound material like music or speech is played as intuitive means and motivating feedback to address humans. The sound material is transformed in order to indicate deviations from the target movement. With this sonification approach, subjects perceive the sounds they have cho-sen themselves in undistorted playback as long as they perform the training task appropriately. Our main premises are a simple map-ping of movement to sound and common sense metaphors, that both enhance the understanding for the subject. 1