APE at Scale and its Implications on MT Evaluation Biases
Table 10: Average Bleu scores for WMT18 English→German newstest2014-2017.
['[EMPTY]', '[BOLD] average orig-de', '[BOLD] average orig-en']
Instead of training an APE model on (RTT(y),y) sentence pairs sentence pairs. Overall, the performance decreases on both the German-original half and the English-original half. Interestingly, the Bleu scores of the reverse APE model on the English-original half are higher than those of the normal APE model. This demonstrates again that sentences evaluated on the English-original half prefer output that is biased by the translation process.