An Incremental Learning of Neural Network with Multiplication Units for Function Approximation

This paper presents a constructive neural network with sigmoidal units and multiplication units, which can uniformly approximate any continuous function on a compact set in multi-dimensional input space. This network provides a more efficient and regular architecture compared to existing higher-order feedforward networks while maintaining their fast learning property. Proposed network provides a natural mechanism for incremental network growth. Simulation results on function approximation problem are given to highlight the capability of the proposed network. In particular, self-organizing process with RasID learning algorithm developed for the network is shown to yield smooth generation and steady learning