Mapping a Single Data Stream to Multiple Auditory Variables: a Subjective Approach to Creating a Compelling Design

Representing a single data variable changing in time via sonification, or using that data to control a sound in some way appears to be a simple problem but actually involves a significant degree of subjectivity. This paper is a response to my own focus on specific sonification tasks (Kramer 1990, 1993) (Fitch & Kramer, 1994), on broad theoretical concerns in auditory display (Kramer 1994a, 1994b, 1995), and on the representation of high-dimensional data sets (Kramer 1991a & Kramer & Ellison, 1991b). The design focus of this paper is partly a response to the others who, like myself, have primarily employed single fundamental acoustic variables such as pitch or loudness to represent single data streams. These simple representations have framed three challenges: Behavioral and Cognitive Science-Can sonifications created with complex sounds changing simultaneously in several dimensions facilitate the formation of a stronger internal auditory image, or audiation, than would be produced by simpler sonifications? Human Factors and Applications-Would such a stronger internal image of the data prove to be more useful from the standpoint of conveying information? Technology and Design-How might these richer displays be constructed? This final question serves as a starting point for this paper. After years of cautious sonification research I wanted to explore the creation of more interesting and compelling representations.