Modeling Past and Future for Neural Machine Translation
Table 2: Case-insensitive BLEU on Chinese-English Translation. “Loss” means applying loss functions for Future layer (Frnn) and Past layer (Prnn).
['#', '[BOLD] Model', 'Dev', 'MT02', 'MT04', 'MT05', 'MT06', 'Avg.', 'Δ']
Clearly the proposed approach significantly improves the translation quality in all cases, although there are still considerable differences among different variants.