Custom made wireless systems for interactive footstep sounds synthesis

This paper describes both the hardware and software development of three custom made wireless systems used for the interactive synthesis of footstep sounds. The data collected from the detection of the feet movements of a walker are used for real-time control of physical models for the auditory display of different ground textures and shoe types. The first system is based on a wooden plank under which an array of microphones is placed. The second system exploits the motion capture technology. The third system consists of a pair of sandals enhanced with two force sensitive resistors and two 3-axes accelerometers for each shoe. The characteristics of the three architectures are discussed and compared. The developed locomotion interfaces find application in several contexts, such as augmented reality, virtual reality, or entertainment, as well as in perceptual studies investigating the influence of interactive sounds on locomotion performance usable for training and rehabilitation purposes.