1Tactile Object Recognition From Appearance Information

Abstract—This paper explores the connection between sensor-based perception and exploration in the context of haptic ob-ject identification. The proposed approach combines (i) object recognition from tactile appearance with (ii) purposeful haptic exploration of unknown objects to extract appearance infor-mation. The recognition component brings to bear computer vision techniques by viewing tactile sensor readings as images. We present a bag-of-features framework that uses several tactile image descriptors, some adapted from the vision domain, others novel, to estimate a probability distribution over object identity as an unknown object is explored. Haptic exploration is treated as a search problem in a continuous space to take advantage of sampling-based motion planning to explore the unknown object and construct its tactile appearance. Simulation experiments of a robot arm equipped with a haptic sensor at the end-effector provide promising validation, indicating high accuracy in identifying complex shapes from tactile information gathered during exploration. The proposed approach is also validated by using readings from actual tactile sensors to recognize real objects. I