Text normalization with varied data sources for conversational speech language modeling

Collecting sufficient language model training data for good speech recognition performance in a new domain is often difficult. How-ever, there may be other sources of data that are matched in terms of topic or style, if not both. This paper looks at the use of text normalization tools to make these data more suitable for language model training, in conjunction with mixture models to combine data from different sources. We specifically address the task of recognizing meeting speech, showing a small reduction in word error rate over a baseline language model trained from conversa-tional speech data. 1