Coordinators:

This project proposes to use the analysis of facial expression as well as tracking of the user's state (i.e. using physiological signals and eye tracking) in an augmented driver simulator able to appropriately react to critical situations (such as hypovigilence and stress conditions) 1.Project objective The main goal of this project is to use multimodal signals processing analysis to provided an augmented user's interface for driving. The term augmented here can be understood as such kind of attentive interface supporting the user interaction. So far at most basic level, the system should contain at least four components: 1. sensors for determining user state 2. an inference engine or feature extractor to evaluate incoming sensor information 3. an adaptive user interface based on the results from step 2 4. and an underlying computational architecture to integrate these components. In reality a fully functioning system would have many more components, but these are the most critical for inclusion as an augmented cognition system and will b