Training phrase-based machine translation models on the cloud: Open source machine translation toolkit chaski. The Prague

In this paper we present an opensource machine translation toolkit Chaski which is ca-pable of training phrase-based machine translation models on Hadoop clusters. The toolkit provides a full training pipeline including distributed word alignment, word clustering and phrase extraction. The toolkit also provides an extended error-tolerance mechanism over stan-dardHadoop error-tolerance framework. The paper will describe the underlyingmethodology and the design of the system, together with instructions of how to run the system on Hadoop clusters. 1