Modality management for multimodal human-machine interfaces

Abstract Synergistic multimodal human-machine interfaces are characterised by their ability to interpret user input from more than one input modality. Such interfaces may contribute to better driver information systems in terms of efficieny and comfort of use. In this article we present an approach for the integration of voice and touchscreen input as well as capacitive proximity sensing for two scenarios: interaction with a map of points of interest and with a media player. We will present de-tails of the system realisation and of the implementation of the scenarios. Finally, we will report results from a recent user study.