Object Deixis: Interaction Between Verbal Expressions and Manual Pointing Gestures

Pfeiffer T. Object Deixis: Interaction Between Verbal Expressions and Manual Pointing Gestures. In: Haack J, Wiese H, Abraham A, Chiarcos C, eds. Proceedings of the KogWis 2010. Potsdam: Universitätsverlag Potsdam; 2010: 221-222.Object deixis is at the core of language and an ideal example of multimodality. Speech, gaze and manual gestures are used by interlocutors to refer to objects in their 3D environment. The interplay of verbal expressions and gestures during deixis is an active research topic in linguistics as well as in human-computer interaction. Previously, we conducted a study on manual pointing during dialogue games using state-of-the art tracking technologies to record gestures with high spatial precision (Kranstedt, Lücking, Pfeiffer, Rieser and Wachsmuth, 2006), To reveal strategies in manual pointing gestures, we present an analysis of this data with a new visualization technique