UML for automotive multi–modal HCI

Multi–modality can help to ease operation and avoid driver distraction, but is hard to specify and in turn makes spec-ification more complex. Existing HCI modeling approaches lack compatibility to the Unified Modeling Language stan-dard. They neither follow formal semantics nor provide methods addressing multi–modality. We base our approach on a formal semantics resolving ambiguities of the UML. We introduce new stereotypes for multi–modality and present a modeling method and tool support, both following our se-mantics. Proof of concept is given by an automotive multi– modal dialogue specification. 1. BACKGROUND Up to now, no standard method for modeling complex multi– modal Human–Computer Interactions (HCIs) in the car ex