Neural Reranking Improves Subjective Quality of Machine Translation: NAIST at WAT2015
Table 1: Overall BLEU, RIBES, and HUMAN scores for our baseline system and system with neural MT reranking. Bold indicates a significant improvement according to bootstrap resampling at p<0.05 [Koehn2004].
['System', 'en-ja B', 'en-ja R', 'en-ja H', 'ja-en B', 'ja-en R', 'ja-en H', 'zh-ja B', 'zh-ja R', 'zh-ja H', 'ja-zh B', 'ja-zh R', 'ja-zh H']
It should be noted that these gains are achieved even though the original baseline was already quite strong (outperforming most other WAT2015 systems without a neural component). While neural MT reranking has been noted to improve traditional systems with respect to BLEU score in previous work In the following section, we will examine the results in more detail and attempt to explain exactly what is causing this increase in translation quality.