Real-time 3-D Data Acquisition for Augmented Reality Man and Machine Interfacing

Based on recent discoveries, we present a method to project a single structured pattern and then reconstruct the threedimensional range from the distortions in the reflected and captured image. Traditional structured light methods require several different patterns to recover the depth, without ambiguity and albedo sensitivity, and are corrupted by object movement during the projection/capture process. Our method efficiently combines multiple patterns into a single composite pattern projection – allowing for real-time implementations. Because structured light techniques require standard image capture and projection technology, unlike time of arrival techniques, they are relatively low cost. Attaining low cost 3D video acquisition would have a profound impact on most applications that are presently limited to 2D video imaging. Furthermore, it would enable many other applications. In particular, we are studying real time depth imagery for tracking hand motion and rotation as an interface to a virtual reality. Applications include remote controlled robotic interfacing in space, advanced cockpit controls and computer interfacing for the disabled