Modulation spectrum analysis for recognition of reverberant speech

Recognition of reverberant speech constitutes a challenging problem for typical speech recognition systems. This is mainly due to the conventional short-term analysis/compensation tech-niques. In this paper, we present a feature extraction technique based on modeling long segments of temporal envelopes of the speech signal in narrow sub-bands using frequency domain lin-ear prediction (FDLP). FDLP provides an all-pole approxima-tion of the Hilbert envelope of the signal by linear prediction on cosine transform of the signal. We show that the FDLP modulation spectrum plays an important role in the robustness of the proposed feature extraction. Automatic speech recogni-tion (ASR) experiments on speech data degraded with a number of room impulse responses (with varying degrees of distortion) show significant performance improvements for the proposed FDLP features when compared to other robust feature extrac-tion techniques (average relative reduction of 40 % in word er-ror rate). Similar improvements are also obtained for far-field data which contain natural reverberation in background noise