K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations

ABSTRACT: Recognizing emotions during social interactions has many potential applications with the popularization of low-cost mobile sensors, but a challenge remains with the lack of naturalistic affective interaction data. Most existing emotion datasets do not support studying idiosyncratic emotions arising in the wild as they were collected in constrained environments. Therefore, studying emotions in the context of social interactions requires a novel dataset, and K-EmoCon is such a multimodal dataset with comprehensive annotations of continuous emotions during naturalistic conversations. The dataset contains multimodal measurements, including audiovisual recordings, EEG, and peripheral physiological signals, acquired with off-the-shelf devices from 16 sessions of approximately 10-minute long paired debates on a social issue. Distinct from previous datasets, it includes emotion annotations from all three available perspectives: self, debate partner, and external observers. Raters annotated emotional displays at intervals of every 5 seconds while viewing the debate footage, in terms of arousal-valence and 18 additional categorical emotions. The resulting K-EmoCon is the first publicly available emotion dataset accommodating the multiperspective assessment of emotions during social interactions. +---------------------------------------+ | Changelog (last updated: Jul 7, 2020) | +---------------------------------------+ * Version 1.0.0 (Jul 7, 2020): - Updated emotion_annotations.tar.gz: - Updated aggregated external annotations to support the reproduction of technical validation results. * Version 0.2.0 (May 11, 2020): - Added data_quality_tables.tar.gz - Updated emotion_annotations.tar.gz - Newly added aggregated external annotations. - Updated metadata.tar.gz: - Added a new column to data_availability.csv to show the availability of aggregated external annotations. * Version 0.1.0 (Apr 25, 2020): - Added debate_audios.tar.gz - Added debate_recordings.tar.gz - Added e4_data.tar.gz - Added emotion_annotations.tar.gz (self, partner, external) - Added metadata.tar.gz - Added neurosky_polar_data.tar.g