Learning machine translation from in-domain and out-of-domain data

AuthorSearch for: ; Search for: ; Search for:
TypeArticle
Proceedings titleProceedings of the 16th Annual Conference of the European Association for Machine Translation
Conference16th Annual Conference of the European Association for Machine Translation (EAMT), 28-30 May 2012, Trento, Italy
Pages305312; # of pages: 8
AbstractThe performance of Phrase-Based Statistical Machine Translation (PBSMT) systems mostly depends on training data. Many papers have investigated how to create new resources in order to increase the size of the training corpus in an attempt to improve PBSMT performance. In this work, we analyse and characterize the way in which the in-domain and outof- domain performance of PBSMT is impacted when the amount of training data increases. Two different PBSMT systems, Moses and Portage, two of the largest parallel corpora, Giga (French-English) and UN (Chinese-English) datasets and several in- and out-of-domain test sets were used to build high quality learning curves showing consistent logarithmic growth in performance. These results are stable across language pairs, PBSMT systems and domains. We also analyse the respective impact of additional training data for estimating the language and translation models. Our proposed model approximates learning curves very well and indicates the translation model contributes about 30% more to the performance gain than the language model.
Publication date
LanguageEnglish
AffiliationInformation and Communication Technologies; National Research Council Canada
Peer reviewedYes
NPARC number21268098
Export citationExport as RIS
Report a correctionReport a correction
Record identifierb9e5bc8b-b13a-4964-96b6-ac4a29c17a65
Record created2013-04-09
Record modified2016-05-09
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)