Classifying emotions in human-machine spoken dialogs

This paper reports on the comparison between various acoustic feature sets and classification algorithms for classifying spoken utterances based on the emotional state of the speaker. The data set used for the analysis comes from a corpus of human-machine dialogs obtained from a commercial application. Emotion recognition is posed as a pattern recognition problem. We used three different techniques-linear discriminant classifier (LDC), k-nearest neighborhood (k-NN) classifier, and support vector machine classifier (SVC)- for classifying utterances into 2 emotion classes: negative and non-negative. In this study, two feature sets were used; the base feature set obtained from the utterance-level statistics of the pitch and energy of the speech, and the feature set analyzed by PCA. PCA showed that it can show the performance comparable to base feature sets. Overall, LDC achieved the best performance with error rates 27.54 % on female data and 25.46 % on males with the base feature set. SVC, however, showed better performance in the problem of data sparsity. 1