Beyond hand-eye coordination : An exploration of eye-tracking and speech recognition as a navigation tool for interactive systems

The human’s ability to see, listen and speak is naturally embedded in how we interact and communicate with each other, but not only do we interact with other humans, we also spend a lot of time interacting with computers. In our study we take a starting point in embodied interaction and draw on people’s abilities from everyday life and apply them to computation in form of eye-tracking and speech recognition. Previous research mainly explored these inputs separately and little has been discovered regarding the combination. We applied a qualitative approach consisting of free surfs, task based evaluations and ten interviews, and we aimed for an understanding of how people perceive this interaction and to discover potential use contexts. The results indicate that people are positive towards the combination of eye-tracking and speech recognition for interacting with computers but found it hard to imagine a rich set of contexts in which it could be used