User and System Cross-Learning of Gesture Commands on Pen-Based Devices

Part 7: Gesture-Based User Interface Design and Interaction IIInternational audienceThis paper presents a new design and evaluation of customizable gesture commands on pen-based devices. Our objective is to help users during the definition of gestures by detecting confusion among gestures. We also help the memorization gestures with the guide of a new type of menu “Customizable Gesture Menus”. These menus are associated with an evolving gesture recognition engine that learns incrementally, starting from few data samples. Our research focuses on making user and recognition system learn at the same time, hence the term “cross-learning”. Three experimentations are presented in details in this paper to support these ideas