Efficient Wait-k Models for Simultaneous Machine Translation
Table 1: Evaluation of Pervasive Attention (PA) and Transformer (TF) for offline translation with greedy decoding.
['Encoder Architecture', 'Unidirectional PA', 'Unidirectional TF', 'Bidirectional PA', 'Bidirectional TF', '[BOLD] 26.81', '26.58', '27.54', '27.70', '27.23', '[BOLD] 27.46', '27.96', '[BOLD] 28.27']
Transformer (TF) models with both a unidirectional encoder and a bidirectional encoder. Overall, and as expected, bidirectional encoders in the offline setup are better than their unidirectional counterparts. The gain for PA is of 0.65 on average while for TF the addition of bidirectionality improves BLEU by 1.1 on average.