GPU-accelerated Real-Time 3D Tracking for Humanoid Locomotion and Stair Climbing

Abstract—For humanoid robots to fully realize their biped potential in a three-dimensional world and step over, around or onto obstacles such as stairs, appropriate and efficient approaches to execution, planning and perception are required. To this end, we have accelerated a robust model-based three-dimensional tracking system by programmable graphics hard-ware to operate online at frame-rate during locomotion of a humanoid robot. The tracker recovers the full 6 degree-of-freedom pose of viewable objects relative to the robot. Leverag-ing the computational resources of the GPU for perception has enabled us to increase our tracker’s robustness to the significant camera displacement and camera shake typically encountered during humanoid navigation. We have combined our approach with a footstep planner and a controller capable of adaptively adjusting the height of swing leg trajectories. The resulting integrated perception-planning-action system has allowed an HRP-2 humanoid robot to successfully and rapidly localize, approach and climb stairs, as well as to avoid obstacles during walking. I