Sources of Evidence for Automatic Indexing of Political Texts

Abstract. Political texts on the Web, documenting laws and policies and the pro-cess leading to them, are of key importance to government, industry, and every individual citizen. Yet access to such texts is difficult due to the ever increas-ing volume and complexity of the content, prompting the need for indexing or annotating them with a common controlled vocabulary or ontology. In this pa-per, we investigate the effectiveness of different sources of evidence—such as the labeled training data, textual glosses of descriptor terms, and the thesaurus structure—for automatically indexing political texts. Our main findings are the following. First, using a learning to rank (LTR) approach integrating all features, we observe significantly better performance than previous systems. Second, the analysis of feature weights reveals the relative importance of various sources of evidence, also giving insight in the underlying classification problem. Third, a lean-and-mean system using only four features (text, title, descriptor glosses, de-scriptor term popularity) is able to perform at 97 % of the large LTR model