Riemannian framework for robust covariance matrix estimation in spiked models

International audienceThis paper aims at providing an original Riemannian geometry to derive robust covariance matrix estimators in spiked models (i.e. when the covariance matrix has a low-rank plus identity structure). The considered geometry is the one induced by the product of the Stiefel manifold and the manifold of Hermitian positive definite matrices, quotiented by the uni-tary group. One of the main contributions is to consider a Riemannian metric related to the Fisher information metric of elliptical distributions, leading to new representations for the tangent spaces and a new retraction. A new robust covari-ance matrix estimator is then obtained as the minimizer of Tyler's cost function, redefined directly on the set of low-rank plus identity matrices, and computed with the aforementioned tools. The main interest of this approach is that it appears well suited to the cases where the sample size is lower than the dimension , as illustrated by numerical experiments