Automatic Speech Recognition Experi

In this paper we investigate the use of articulatory data for speech recognition. Recordings of the articulatory movements originate from the MOCHA corpus, a database which contains speech, EGG, EMA and EPG recordings. It was found that in a Hidden Markov Model (HMM) based recognition framework careful pro-cessing of these signals can yield significantly better performance than that obtained by decoding of the acoustic signals. We present detailed results on the processing of the signals and the associ-ated performance of monophone and triphone systems. Experi-mental evidence shows that acoustic-signal-to-word mappings and articulatory-signal-to-word mappings are equally complex. How-ever, for the latter, evidence of short-comings of standard HMM based modelling is visible and should be addressed in future sys-tems. Index Terms: articulatory representations, speech recognition. 1