Neural Machine Translation with Error Correction
Table 2: BLEU score on WMT14 En→De and WMT16 En→Ro.
['Method', 'En→De', 'En→Ro']
In order to validate the performance of our method on large-scale datasets, we also conduct experiments on WMT14 En→De and WMT16 En→Ro. We found when incorporating error correction mechanism into the NMT model, it can achieve 29.20 and 34.70 BLEU score, which outperforms our baseline by 0.8 and 1.6 points in En→De and En→Ro, and is comparable to the previous works. These significant improvements on two large-scale datasets also demonstrate the effectiveness and robustness of our method in solving exposure bias. In addition, our approach is also compatible with previous works, i.e., our method can achieve better performance if combined with other advanced structure.