Compressive sensing on manifolds using a nonparametric mixture of factor analyzers: Algorithm and performance bounds

Abstract—Nonparametric Bayesian methods are employed to constitute a mixture of low-rank Gaussians, for data that are of high dimension but are constrained to reside in a low-dimensional subregion of. The number of mixture com-ponents and their rank are inferred automatically from the data. The resulting algorithm can be used for learning manifolds and for reconstructing signals from manifolds, based on compressive sensing (CS) projection measurements. The statistical CS inver-sion is performed analytically. We derive the required number of CS random measurements needed for successful reconstruction, based on easily-computed quantities, drawing on block-sparsity properties. The proposed methodology is validated on several synthetic and real datasets. Index Terms—Beta process, compressive sensing, Dirichlet process, low-rank Gaussian, manifold learning, mixture of facto