Exploiting Patent Information for the Evaluation of Machine Translation

We have produced a test collection for ma-chine translation (MT). Our test collection in-cludes approximately 2 000 000 sentence pairs in Japanese and English, which were extracted from patent documents and can be used to train and evaluate MT systems. Our test col-lection also includes search topics for cross-lingual information retrieval, to evaluate the contribution of MT to retrieving patent docu-ments across languages. We performed a task for MT at the NTCIR workshop and used our test collection to evaluate participating groups. This paper describes scientific knowledge ob-tained through our task