A Common Neural Network Model for Unsupervised Exploratory Data Analysis and Independent Component Analysis

This paper presents the derivation of an unsupervised learning algorithm, which enables the identification and visualisation of latent structure within ensembles of high dimensional data. This provides a linear projection of the data onto a lower dimensional subspace to identify the characteristic structure of the observations independent latent causes. The algorithm is shown to be a very promising tool for unsupervised exploratory data analysis and data visualisation. Experimental results confirm the attractiveness of this technique for exploratory data analysis and an empirical comparison is made with the recently proposed Generative Topographic Mapping (GTM) and standard principal component analysis (PCA). Based on standard probability density models a generic nonlinearity is developed which allows both; 1) identification and visualisation of dichotomised clusters inherent in the observed data and, 2) separation of sources with arbitrary distributions from mixtures, whose dimensiona..