Representation based translation evaluation metrics

Download
  1. (PDF, 319 KB)
DOIResolve DOI: http://doi.org/10.3115/v1/P15-2025
AuthorSearch for: ; Search for:
TypeArticle
Proceedings titleProceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7the International Joint Conference on Natural Language Processing (Short Papers), Beijing, China, July 26-31, 2015
ConferenceThe 53rd Annual Meeting of the Association for Computational Linguistics and the 7the International Joint Conference on Natural Language Processing, July 26-31, 2015, Beijing, China
ISBN9781510808461
1510808469
Pages150155
AbstractPrecisely evaluating the quality of a translation against human references is a challenging task due to the flexible word ordering of a sentence and the existence of a large number of synonyms for words. This paper proposes to evaluate translations with distributed representations of words and sentences. We study several metrics based on word and sentence representations and their combination. Experiments on the WMT metric task shows that the metric based on the combined representations achieves the best performance, outperforming the state-of-the-art translation metrics by a large margin. In particular , training the distributed representations only needs a reasonable amount of mono-lingual, unlabeled data that is not necessary drawn from the test domain.
Publication date
PublisherAssociation for Computational Linguistics
LanguageEnglish
AffiliationNational Research Council Canada; Information and Communication Technologies
Peer reviewedYes
NPARC number23001598
Export citationExport as RIS
Report a correctionReport a correction
Record identifier809f1ba9-a11b-47d8-950b-39292e695ddb
Record created2017-03-09
Record modified2017-03-09
Bookmark and share
  • Share this page with Facebook (Opens in a new window)
  • Share this page with Twitter (Opens in a new window)
  • Share this page with Google+ (Opens in a new window)
  • Share this page with Delicious (Opens in a new window)