Tactile Convolutional Networks for Online Slip and Rotation Detection

Meier M, Patzelt F, Haschke R, Ritter H. Tactile Convolutional Networks for Online Slip and Rotation Detection. In: Villa AEP, Masulli P, Pons Rivero AJ, eds. Artificial Neural Networks and Machine Learning – ICANN 2016 25th International Conference on Artificial Neural Networks, Barcelona, Spain, September 6-9, 2016, Proceedings, Part II. Lecture Notes in Computer Science. Vol 9887. Cham: Springer; 2016: 12-19.We present a deep convolutional neural network which is capable to distinguish between different contact states in robotic manipulation tasks. By integrating spatial and temporal tactile sensor data from a piezo-resistive sensor array through deep learning techniques, the network is not only able to classify the contact state into stable versus slipping, but also to distinguish between rotational and translation slippage. We evaluated different network layouts and reached a final classification rate of more than 97 %. Using consumer class GPUs, slippage and rotation events can be detected within 10 ms, which is still feasible for adaptive grasp control