Modular combination of deep neural networks for acoustic modeling

In this work, we propose a modular combination of two pop-ular applications of neural networks to large-vocabulary con-tinuous speech recognition. First, a deep neural network is trained to extract bottleneck features from frames of mel scale filterbank coefficients. In a similar way as is usually done for GMM/HMM systems, this network is then applied as a non-linear discriminative feature-space transformation for a hybrid setup where acoustic modeling is performed by a deep belief network. This effectively results in a very large network, where the layers of the bottleneck network are fixed and applied to suc-cessive windows of feature frames in a time-delay fashion. We show that bottleneck features improve the recognition perfor-mance of DBN/HMM hybrids, and that the modular combina-tion enables the acoustic model to benefit from a larger tempo-ral context. Our architecture is evaluated on a recently released and challenging Tagalog corpus containing conversational tele-phone speech