APE at Scale and its Implications on MT Evaluation Biases
Table 7: Bleu scores for WMT15 English→French.
['[EMPTY]', '[BOLD] newstest2014']
We see the same tendency as we saw for German and Romanian. When applying our APE system on the output of the bitext baseline, we get a small improvement of 0.1 Bleu. By only post-editing the French-original half, we get an improvement of 1.0 Bleu points. The same effect can be seen on the English→French system that is trained with Noised BT. We yield quality improvements of 0.8 Bleu by applying our APE model on the French-original half of the test set only.