Towards an Embedded

In the neurological system of primates, changes in posture are de-tected by the central nervous system through a vestibular process. This process, located in the inner ear, coordinates several system out-puts to maintain stable balance, visual gaze, and autonomic control in response to changes in posture. Consequently the vestibular data is merged to other sensing data like touch, vision,.... The visuo-inertial merging is crucial for several tasks like navigation, depth estima-tion, stabilization. This paper proposes a “primate-inspired ” sens-ing hardware, based on a CMOS imaging and an artificial vestibu-lar system. The whole sensor can be considered like a smart embed-ded sensor where one of the most original aspects of this approach is the use of a System On Chip implemented in a FPGA to manage the whole system. The sensing device is designed around a 4 million pixels CMOS imager and the artificial vestibular set is composed of three linear accelerometers and three gyroscopes. With its structure, the system provides a high degree of versatility and allows the im-plementation of parallel image and inertial processing algorithms. In order to illustrate the proposed approach, depth estimation with Kalman filtering implementation is carried out. KEY WORDS—CMOS imager, visuo-inertial sensor, depth estimation, Kalman filter, smart sensor SeeMOS 1