Add to ORKGAbstract. Multimodal systems must process several input streams efficiently and represent the input in a way that allows the establishment of connections between modalities. This paper describes a multimodal system that uses Combinatory Categorial Grammars to parse several input streams and translate them into logical formulas. These logical formulas are expressed in Hybrid Logic, which is very suitable for multimodal integration because it can represent temporal relationships between modes in an abstract way. This level of abstraction makes it possible to define rules for multimodal processing in a straightforward way.
this paper we present several extensions to a deduction method for parsing with multimodal logical g...
In this paper we compare grammatical inference in the context of simple and of mixed Lambek systems....
Abstract. A user experiment on multimodal interaction (speech, hand position and hand shapes) to stu...
Multimodal interfaces enable more natural and effective human-computer interaction by providing mult...
Modem user interfaces can take advantage of multiple input modalities such as speech, gestures, hand...
Human communication is naturally multimodal. People normally interact through several communication ...
The paper shows how Combinatory Categorial Grammar (CCG) can be adapted to take advantage of the e...
The development of multimodal interfaces and algorithms for multimodal integration requires knowledg...
This is a new hybrid fusion strategy based primarily on the implementation of two former and differe...
The question addressed in this paper is simple. If the argumentative function of a multimodal narra...
Multimodal systems can represent and manipulate semantics from different human communication modalit...
Multimodal interfaces require effective parsing and understanding of utterances whose content is dis...
International audienceRepresenting the behaviour of multimodal interactive systems in a complete, co...
We describe how multimodal grammars for dialogue systems can be written using the Grammatical Framew...
Multimodal integration is an important problem of multimodal user interface research. After briefly ...
this paper we present several extensions to a deduction method for parsing with multimodal logical g...
In this paper we compare grammatical inference in the context of simple and of mixed Lambek systems....
Abstract. A user experiment on multimodal interaction (speech, hand position and hand shapes) to stu...
Multimodal interfaces enable more natural and effective human-computer interaction by providing mult...
Modem user interfaces can take advantage of multiple input modalities such as speech, gestures, hand...
Human communication is naturally multimodal. People normally interact through several communication ...
The paper shows how Combinatory Categorial Grammar (CCG) can be adapted to take advantage of the e...
The development of multimodal interfaces and algorithms for multimodal integration requires knowledg...
This is a new hybrid fusion strategy based primarily on the implementation of two former and differe...
The question addressed in this paper is simple. If the argumentative function of a multimodal narra...
Multimodal systems can represent and manipulate semantics from different human communication modalit...
Multimodal interfaces require effective parsing and understanding of utterances whose content is dis...
International audienceRepresenting the behaviour of multimodal interactive systems in a complete, co...
We describe how multimodal grammars for dialogue systems can be written using the Grammatical Framew...
Multimodal integration is an important problem of multimodal user interface research. After briefly ...
this paper we present several extensions to a deduction method for parsing with multimodal logical g...
In this paper we compare grammatical inference in the context of simple and of mixed Lambek systems....
Abstract. A user experiment on multimodal interaction (speech, hand position and hand shapes) to stu...