Realtime Dynamic Multimedia Storyline Based on Online Audience Biometric Information

Abstract. Audience complete action immersion sensation is still the ultimate goal of the multimedia industry. In spite of the significant technical audiovi-sual advances that enable more realistic contents, coping with individual audi-ence needs and desires is still an incomplete achievement. The proposed project’s intention is to solve this issue through enabling real-time dynamic multimedia storylines with emotional subconscious audience interaction. Individual emoti-onal state assessment is accomplished by direct access to online biometric in-formation. Recent technologic breakthroughs have enabled the usage of minimal invasive biometric hardware devices that no longer interfere with the audience immersion feeling. Other project’s key module is the conceptualization of a dy-namic storyline multimedia content system with emotional metadata, responsible for enabling discrete or continuous storyline route options. The unifying unit is the definition of the full-duplex communication protocol. The current stage of research has already produced a spin-off product capable of providing computer mouse control through electromyography and has identified key factors in human emotions through experiments conducted in the developed system’s architecture that have enabled semi-automatic emotion assessment.