Content-Based Image Retrieval by Multimodal Interaction

Bauckhage C, Käster T, Pfeiffer M, Sagerer G. Content-Based Image Retrieval by Multimodal Interaction. In: Proc. of the 29th Annual Conference of the IEEE Industrial Electronics Society. Roanoke, VA; 2003: 1865-1870.Due to the size of todays professional image databases, the standard approach to content-based image retrieval is to interactively navigate through the content. However, most people whose job necessitates working with such databases do not have a technical background. Commercial practice thus requires efficient retrieval techniques as well as navigation interfaces that are intuitive to use and easy to learn. In this paper we introduce a system for interactive image retrieval that combines different approaches to feature based queries. Furthermore, it allows multimodal interaction because apart from conventional input devices like mouse and keyboard, it is possible to operate the system using a touch screen or even natural language. Besides technical details and results on retrieval accuracy, we will also present results of usability experiments which underline that users well appreciate multimodal interfaces for image retrieval