An Experimental Study on Dynamic Features of Speech Structure

One of the biggest difficulties in automatic speech recognition (ASR) is how to deal with variations of speech signals caused by non-linguistic information, such as age, gender, etc. Vari-ous methods have been proposed to compensate for the vari-ations and one of them is speech structure [1]. Speech struc-ture, which extracts only contrastive features and discards absolute features, is proved to be transform-invariant math-ematically and to be very robust with the non-linguistic vari-ations experimentally [2]. Although the conventional speech structure extracts local and distant contrastive features, it did not extract dynamic features explicitly which are supposed to exist in the contrastive features. In this paper, we refor-mulate speech structure based on trajectory HMM and derive trajectory structure (TSR), in which dynamic and contrastive features can be defined and used in ASR. We carry out an experiment of n-best rescoring of isolated word recognition using trajectory structure and obtain 28.5 % relative decrease in word error rate. 1