Locally Recurrent Neural Networks For Efficient Realization Of A Speech Recognizer

The computational complexity of speech recognizers based on fully connected recurrent neural networks, i.e. the large number of connections, prevents a hardware realization. We introduced locally connected recurrent neural networks in order to keep the properties of recurrent neural networks and to reduce the connectivity density of the network. A special form of feature presentation and output coding is developed which reduces the computational complexity and allows learning of longterm dependencies. By applying all these methods a locally recurrent neural network results, which has only one third of the weights as a fully connected recurrent network. Thus, with this concept a speech recognition system can be realized on a single VLSI-Chip. 1 INTRODUCTION In former work [1, 2] it has been shown that recurrent neural networks (RNN) are powerful tools for speech recognition. A speech recognizer system (SRS) which is based on a single RNN achieves a recognition performance for isolated ..