Feature Extraction for Regression Problems and an Example Application for Pose Estimation of a Face

Abstract. In this paper, we propose a new feature extraction method for regres-sion problems. It is a modified version of linear discriminant analysis (LDA) which is a very successful feature extraction method for classification problems. In the proposed method, the between class and the within class scatter matrices in LDA are modified so that they fit in regression problems. The samples with small differences in the target values are used to constitute the within class scatter ma-trix while the ones with large differences in the target values are used for the between class scatter matrix. We have applied the proposed method in estimat-ing the head pose and compared the performance with the conventional feature extraction methods