Physical, semantic and pragmatic levels for multimodal fusion and fission

International audienceMultimodal fusion is linked to the integration of information in human-machine interactive systems where several communication modalities are proposed to the user. It is mainly used in input, for instance when the user can interact with the system using speech and<br />2D gestures. As a symmetric process, multimodal fission is linked to the repartition of information among several communication modalities. It is mainly used in output, and consists of one of the processes of an Intelligent Multi-Media Presentation System (IMMPS). We propose a unified vision of multimodal fusion and fission, where parameters for the first are exploited for the second<br />and vice-versa