Using wikipedia links to construct word segmentation corpora

Tagged corpora are essential for evaluating and training nat-ural language processing tools. The cost of constructing large enough manually tagged corpora is high, even when the annotation level is shallow. This article describes a sim-ple method to automatically create a partially tagged cor-pus, using Wikipedia hyperlinks. The resulting corpus con-tains information about the correct segmentation of 523,599 non-consecutive words in 363,090 sentences. We used our method to construct a corpus of Modern Hebrew (which we have made available a