The Role of Personalization and Multiple EEG and Sound Features Selection in Real Time Sonification for Neurofeedback

Abstract: The field of physiology-based interaction and monitoring is developing at a fast pace. Emerging applications like fatigue monitoring often use sound to convey complex dynamics of biological signals and to provide an alternative, non-visual information channel. Most Physiology-to-Sound mappings in such auditory displays do not allow customization by the end-users. We designed a new sonification system that can be used for extracting, processing and displaying Electroencephalography data (EEG) with different sonification strate-gies. The system was validated with four user groups performing alpha/theta neurofeedback training (a/t) for relaxation that varied in feedback personalization (Personalized/Fixed) and a number of sonified EEG fea-tures (Single/Multiple). The groups with personalized feedback performed significantly better in their training than fixed mappings groups, as shown by both subjective ratings and physiological indices. Additionally, the higher number of sonified EEG features resulted in deeper relaxation than when training with single feature feedback. Our results demonstrate the importance of adaptation and personaliziation of EEG sonification ac-cording to particular applications, in our case, to a/t neurofeedback. Our experimental approach shows how user performance can be used for validating different sonification strategies.