Expressiveness and Physicality in Interaction

This article introduces the approach, the developed models, and ongoing research issues on expressiveness and physical interaction in interactive systems, with a special focus on human-robot communication. Research issues and related concrete examples from the interactive multimedia performance \u201cL\u2018Ala dei Sensi\u201d (literally, \u201cThe Wing of the Senses\u201d), held in Ferrara (Italy) in November 1999, are presented. \u201cL\u2018Ala dei Sensi\u201d is formed by different episodes, a subset of which include one or more dancers interacting in real-time with a robot on stage. This interaction can influence and generate computer-generated music and video. Experiments have been conduced on the concept of musical and visual \u201cclones\u201d on large screens interacting with humans and the robot. The underlying models and approaches are introduced, with a special focus on expressiveness in the physical interaction of dancers with mobile robots and with visual/music \u201cclones\u201d. An overview of the hardware and software architecture is shortly presented. A discussion on the results, learned lessons from this experience, and future work concludes the paper