APE at Scale and its Implications on MT Evaluation Biases
Table 4: Bleu scores for WMT18 English→German newstest2018. We apply our APE model only on the German-original half of the test set. Bleu scores are calculated on the full newstest2018 set and the English-original half is just copied from the submission.
['[EMPTY]', 'Microsoft', 'Cambridge']
As our APE model seems agnostic to the model which produced the RTT, we applied it to the best submissions of the recent WMT18 evaluation campaign, applying to German-original half of the test set only. Both systems improved by up to 0.8 points in Bleu.