Article thumbnail

Identifying the machine translation error types with the greatest impact on post-editing effort

By Joke Daems, Sonia Vandepitte, Robert Hartsuiker and Lieve Macken

Abstract

Translation Environment Tools make translators' work easier by providing them with term lists, translation memories and machine translation output. Ideally, such tools automatically predict whether it is more effortful to post-edit than to translate from scratch, and determine whether or not to provide translators with machine translation output. Current machine translation quality estimation systems heavily rely on automatic metrics, even though they do not accurately capture actual post-editing effort. In addition, these systems do not take translator experience into account, even though novices' translation processes are different from those of professional translators. In this paper, we report on the impact of machine translation errors on various types of post-editing effort indicators, for professional translators as well as student translators. We compare the impact of MT quality on a product effort indicator (HTER) with that on various process effort indicators. The translation and post-editing process of student translators and professional translators was logged with a combination of keystroke logging and eye-tracking, and the MT output was analyzed with a fine-grained translation quality assessment approach. We find that most post-editing effort indicators (product as well as process) are influenced by machine translation quality, but that different error types affect different post-editing effort indicators, confirming that a more fine-grained MT quality analysis is needed to correctly estimate actual post-editing effort. Coherence, meaning shifts, and structural issues are shown to be good indicators of post-editing effort. The additional impact of experience on these interactions between MT quality and post-editing effort is smaller than expected

Topics: Social Sciences, LT3, post-editing, machine translation, translation quality, post-editing effort, effort indicators
Publisher: 'Frontiers Media SA'
Year: 2017
DOI identifier: 10.3389/fpsyg.2017.01282
OAI identifier: oai:archive.ugent.be:8528320
Download PDF:
Sorry, we are unable to provide the full text but you may find it at the following location(s):
  • http://dx.doi.org/10.3389/fpsy... (external link)
  • http://hdl.handle.net/1854/LU-... (external link)
  • https://biblio.ugent.be/public... (external link)
  • https://biblio.ugent.be/public... (external link)
  • Suggested articles


    To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.