This paper presents the results of the WMT22 Metrics Shared Task. Participants submitting
automatic MT evaluation metrics were asked to score the outputs of the translation systems …

We address the problem of translating from morphologically poor to morphologically rich
languages by adding per-word linguistic information to the source language. We use the syntax …

This paper presents the results of the First WMT Shared Task on Sign Language Translation
(WMT-SLT22). This shared task is concerned with automatic translation between signed …

This paper presents the results of the WMT23 Metrics Shared Task. Participants submitting
automatic MT evaluation metrics were asked to score the outputs of the translation systems …

Despite the growing interest in and use of machine translation post-edited outputs, there is
little research work exploring different types of post-editing operations, ie types of translation …

This work presents the new flexible Multidimensional Quality Metrics (MQM) framework and
uses it to analyze the performance of state-of-the-art machine translation systems, focusing …

This paper presents the results of the General Machine Translation Task organised as part
of the 2023 Conference on Machine Translation (WMT). In the general MT task, participants …

We describe a submission to the WMT12 Quality Estimation task, including an extensive
Machine Learning experimentation. Data were augmented with features from linguistic analysis …

We present the results of the application of a grammatical test suite for German$\rightarrow$English
MT on the systems submitted at WMT19, with a detailed analysis for 107 …

We present an analysis of 16 state-of-the-art MT systems on German-English based on a
linguistically-motivated test suite. The test suite has been devised manually by a team of …