Multimodal integration using complex feature set

Multimodal integration is an important problem of multimodal user interface research. After briefly surveying research on multimodal integration, this paper introduced a natural language processing method to resolve the problem of integration. It introduced the unification operation on complex feature set and extended this operation in order to represent the information from input modalities and implement multimodal integration.Computer Science, Interdisciplinary ApplicationsComputer Science, Theory & MethodsCPCI-S(ISTP)