Hybrid neural networks: An evolutionary approach with local search

Considering computational algorithms available in the literature, associated with supervised learning in feedforward neural networks, a wide range of distinct approaches can be identified. While the adjustment of the connection weights represents an omnipresent stage, the algorithms differ on three basic aspects: the technique chosen to determine the dimension of the multilayer neural network, the procedure adopted to specify the activation functions, and the kind of composition used to produce the output. Advanced learning algorithms should be developed to simultaneously treat all these aspects during learning, and an evolutionary learning algorithm with local search is proposed here. The essence of this approach is a synergy between genetic algorithms and conjugate gradient optimization, operating on a hybrid neural network architecture. As a consequence, the final neural network is automatically generated, and is characterized to be dedicated and computationally parsimonious.91577