Abstract Style-based Text Categorization: What Newspaper Am I Reading?

Most research on automated text categorization has focused on determining the topic of a given text. While topic is generally the main characteristic of an information need, there are other characteristics that are useful for information retrieval. In this paper we consider the problem of text categorization according to style. For example, we may wish to automatically determine if a given text is taken from a magazine or a newspaper, is an editoral or a news item, is promo-tional or informative, was written by a native English speaker or not, and so on. Learning to determine the style of a document is a dual to that of determining its topic, in that those document features which cap-ture the style of a document are precisely those which are independent of its topic. We here define the fea-tures of a document o be the frequencies of each of a set of function words and parts-of-speech triples. We then use machine learning techniques to classify doc-uments. We test our methods on four collections of newspaper and magazine articles.