Multimodal behavioral analysis for non-invasive stress detection

This study presents and approach to measure the levels of acute stress in humans by analysing their behavioural patterns when interacting with technological devices. We study the effects of stress on eight behavioural, physical and cognitive features. The data was collected with the participation of 19 users in different phases, with different levels of stress induced. A non-parametric statistical hypothesis test is used to determine which features show statistically significant differences, for each user, when under stress. It is shown that the features more related to stress are the acceleration and the mean and maximum intensity of the touch. It is also shown that each user is affected by stress in a specific way. Moreover, all the process of estimating stress is undertaken in a non-invasive way. This work constitutes the foundation of a context layer for a virtual environment for conflict resolution. The main objective is to overcome some of the main drawbacks of communicating online, namely the lack of contextual information such as body language or gestures.The work of Davide Carneiro is supported by a doctoral grant by FCT (SFRH/BD/64890/2009). This work is also partially supported by the Spanish Ministerio de Economia y Competitividad/ FEDER under project TIN2010-20845-C03-01 and by the Spanish Junta de Comunidades de Castilla-La Mancha/ FEDER under project PII2I09-0069-0994