Real-time facial feature tracking from 2D+3D video streams

This paper presents a completely automated 3D facial feature track-ing system using 2D+3D image sequences recorded by a real-time 3D sensor. It is based on local feature detectors constrained by a 3D shape model, using techniques that make it robust under pose and partial occlusion. Several experiments conducted under rela-tively non-controlled conditions demonstrate the accuracy and ro-bustness of the approach. Index Terms — Face recognition, tracking, feature extrac-tion, geometric modelin