Modeling Past and Future for Neural Machine Translation
Table 4: Evaluation of the alignment quality. The lower the score, the better the alignment quality.
['[BOLD] Model', '[BOLD] AER', 'Δ']
We find that the Coverage model do improve attention model. Our model distinguishes the Past and Future directly, which is a higher level coverage mechanism than the word coverage model.