Fusing ladar and color image information for mobile robot feature detection and tracking

In an outdoor, o-road mobile robotics environ-ment, it is important to identify objects that can aect the vehicle's ability to traverse its planned path, and to determine their three-dimensional characteristics. In this paper, a combination of three elements is used to accomplish this task. An imaging ladar collects range images of the scene. A color camera, whose po-sition relative to the ladar is known, is used to gather color images. Information extracted from these sen-sors is used to build a world model, a representation of the current state of the world. The world model is used actively in the sensing to predict what should be visible in each of the sensors during the next imaging cycle. The paper explains how the combined use of these three types of information leads to a robust un-derstanding of the local environment surrounding the robotic vehicle for two important tasks: puddle/pond avoidance and road sign detection. Applications of this approach to road detection are also discussed.