A 2D+3D face identification system for surveillance applications

A novel surveillance system integrating 2D and 3D facial data is presented in this paper, based on a low-cost sensor capable of real-time acquisition of 3D images and associ-ated color images of a scene. Depth data is used for robust face detection, localization and 3D pose estimation, as well as for compensating pose and illumination variations of fa-cial images prior to classification. The proposed system was tested under an open-set identification scenario for surveil-lance of humans passing through a relatively constrained area. Experimental results demonstrate the accuracy and robustness of the system under a variety of conditions usu-ally encountered in surveillance applications. 1