A Workflow for Real-time Visualization and Data Analysis of Gesture using Motion Capture

International audienceIn this paper, we investigate new ways to understand and to analyze human gesture in a researchcontext applied on co-verbal gesture across language. The research project focuses on the quality ofthe movement and consider the gesture “pulse of effort.“ We propose a workflow for real-timegesture analysis to visualize gesture kinematics features (Velocity, Acceleration, Jerk) fromheterogeneous data (Video, Motion Capture and Gesture Annotations) at the same time base. Thetools designed here provide immersive and interactive explorations of data: users can testhypotheses and embody gesture visualization and descriptors adopting different Frames ofReference using augmented reality. We have conducted an evaluation protocol in the field oflinguistics that compares 496 annotated gestures to benchmark the workflow