The use of subword linguistic modeling for multiple tasks in Speech Recognition

Over the past several years, I have been conducting research on subword modeling in speech recognition. The research is most specifically aimed at the difficult task of identifying and characterizing unknown words, although the proposed framework also has utility in other recognition tasks such as phonological and prosodic modeling. The approach exploits the linguistic substructure ofwOPP by describing graphemic, phonemic, phonological, syllabic, and morphemic constraints through a set of context-free rules, and supporting the resulting parse treeswee a corpus- 13 trained probability model. A derived finite state transducer representation forms a natural means for integrating the trained model into a recognizer search. This paper describes several research projects I have been engaged in, together w'O my students and associates, aimed at exploringwpl inwOP( recognition tasks can benefit from such formal modeling ofwO( substructure. These include phonological modeling, hierarchical duration modeling, sound-to-letter and letter-to-sound mapping, and automatic acquisition ofunknow wkno in a speech understanding system. Results of several experiments in these areas are summarized here