Research Article Online feature selection and classication with incomplete data

Abstract:This paper presents a classication system in which learning, feature selection, and classication for incomplete data are simultaneously carried out in an online manner. Learning is conducted on a predened model including the class-dependent mean vectors and correlation coecients, which are obtained by incrementally processing the incoming observations with missing features. A nearest neighbor with a Gaussian mixture model, whose parameters are also estimated from the trained model, is used for classication. When a testing observation is received, the algorithm discards the missing attributes on the observation and ranks the available features by performing feature selection on the model that has been trained so far. The developed algorithm is tested on a benchmark dataset. The eect of missing features for online feature selection and classication are discussed and presented. The algorithm easily converges to the stable state of feature selection with similar accuracy results as those when using the complete and incomplete feature set with up to 50 % missing data