Real-time LSTM-based Multi-dimensional Features Gesture Recognition

Gesture recognition is widely used in the field of sensing.There are three kinds of gesture recognition methods based on computer vision,depth sensor and motion sensor.The recognition based on motion sensor has the advantages of less input data,high speed,and direct acquisition of hand 3D information,which has gradually become a research hotspot.Traditional gesture recognition based on motion sensor can be considered as a pattern recognition problem essentially and its accuracy depends heavily on feature data sets extracted from prior experience.Different from traditional pattern recognition methods,deep learning can greatly reduce the workload of artificial heuristic feature extraction.To solve the problem of traditional pattern recognition,this paper proposes a real-time multi-dimensional features recognition method based on Long Short-Term Memory(LSTM)and the performance of the method is verified by sufficient experiment.The method defines a gesture library consisting of five basic gestures and seven complex gestures at first.Based on the kinematic features of hand posture,the angle features and displacement features are extracted and then the frequency domain features of sensor data are extracted by short-time Fourier transform(SFTF).Then,three features are inputted into deep neural network LSTM for training,so the collected gestures are classified and recognized.At the same time,in order to verify the effectiveness of the proposed method,the gesture data of six volunteers are collected as the experimental data set by self-designed hand-held experience stick.The experimental results show that the accuracy of the recognition method proposed in this paper achieves 94.38% for basic and complex gestures,and the recognition accuracy is improved by nearly 2% compared with the traditional support vector machine,K-nearest neighbor method and fully connected neural network