Flexible X-Y patches for face recognition

In this paper, illuminated by the great success of Universal Back-groundModeling (UBM) for speech/speaker recognition, we present a new algorithm for face recognition. On the one hand, we encode each face image as an ensemble of X-Y patches, which integrate both local appearance and shape information. These X-Y patch repre-sentation provides the possibility to compare two spatially different patches, and consequently alleviates the requirement of exact pixel-wise alignment. On the other hand, we train the UBM based on the X-Y patches from the images of differen subjects, and then automat-ically adapt the UBM for specific subject, and finally face recogni-tion is conducted by comparing the ratio of the likelihoods from the model for specific subject and UBM. UBM elicits the algorithmic ro-bustness to image occlusion since the occluded patches may not con-tribute evidence to any subjects. Comparison experiments with the state-of-the-art subspace learning algorithms, on the popular CMU PIE face database and with varieties of configurations, demonstrate that our proposed algorithm brings significant improvement in face recognition accuracy, and also show the algorithmic robustness to image occlusions