[EN] Simultaneous machine translation has recently
gained traction thanks to significant quality improvements and the advent of streaming applications. Simultaneous translation systems
need to find a trade-off between translation
quality and response time, and with this purpose multiple latency measures have been proposed. However, latency evaluations for simultaneous translation are estimated at the sentence level, not taking into account the sequential nature of a streaming scenario. Indeed,
these sentence-level latency measures are not
well suited for continuous stream translation,
resulting in figures that are not coherent with
the simultaneous translation policy of the system being assessed. This work proposes a
stream-level adaptation of the current latency
measures based on a re-segmentation approach
applied to the output translation, that is successfully evaluated on streaming conditions
for a reference IWSLT task.The research leading to these results has received
funding from the European Union's Horizon 2020
research and innovation program under grant agreement no. 761758 (X5Gon) and 952215 (TAILOR) and Erasmus+ Education program under
grant agreement no. 20-226-093604-SCH; the Government of Spain's research project Multisub, ref.
RTI2018-094879-B-I00 (MCIU/AEI/FEDER,EU)
and FPU scholarships FPU18/04135; and the Generalitat Valenciana's research project Classroom
Activity Recognition, ref. PROMETEO/2019/111.Iranzo-Sánchez, J.; Civera Saiz, J.; Juan, A. (2021). Stream-level Latency Evaluation for Simultaneous Machine Translation. The Association for Computational Linguistics. 664-670. http://hdl.handle.net/10251/182203S66467