Analysis of Robust Soft Learning Vector Quantization

One of the popular methods for multiclass classification is Learning Vector Quantization (LVQ). There have been developed several variants of LVQ lately, among which Robust Soft Learning Vector Quantization, or RSLVQ for short. An introductory study showed that RSLVQ performs better than other LVQ algorithms, even very close to the optimal linear classifier, within a controlled environment. In order to study its performance in detail, we performed a mathematical analysis of the algorithm, in the form of a system of coupled Ordinary Differential Equations (ODE's), which might also help development of an optimal LVQ algorithm. Following from our analysis, we compare the potential performance of RSLVQ in relation to other LVQ variants and present a guideline for settings of the control parameter, i.e. the softness parameter.