Real-Time Control of Sonification Models with an Audio-Haptic Interface

Hermann T, Krause J, Ritter H. Real-Time Control of Sonification Models with an Audio-Haptic Interface. In: Nakatsu R, Kawahara H, eds. Proceedings of the International Conference on Auditory Display. Kyoto, Japan: ICAD; 2002: 82-86.This paper presents a new interface for controlling sonification models. A haptic controller interface is developed which allows both to manipulate a sonification model, e.g. by interacting with it and to provide a haptic data representation. A variety of input types are supported with a hand-sized interface, including shaking, squeezing, hammering, moving, rotating and accelerating. The paper presents details on the interface under development and demonstrates application of the device for controlling a sonification model. For this purpose, the Data-Solid Sonification Model is introduced, which provides an acoustic representation of the local neighborhood relations in high-dimensional datasets for binary classification problems. The model is parameterized by a reduced data representation obtained from a growing neural gas network. Sound examples are given to demonstrate the device and the sonification model