Visual compensation in localization of a robot on a ceiling map

In a visual odometry system, location of a mobile robot is automatically estimated (localized) from video. When the video is captured by an "upward" camera fixed to an indoor mobile robot, a panorama image of the ceiling (ceiling map) is generated by using a visual motion between two adjacent frames in the video. Similarly, location of another robot can be estimated on the ceiling map by using a visual motion between the current frame and the previously generated ceiling map. Under the assumption that the robot goes straight or rotates around a fixed point, there is no problem on the localization as far as the floor is flat. However, when there is debris on the floor, the estimated location contains error. In this paper, we reduce this error by utilizing visual motions in video from the "forward" camera fixed to the robot. This is a visual compensation of motions in the "upward" camera's video with those in the "forward" camera's video. It was experimentally confirmed that the maximum absolute value of the error was reduced to approximately 11