LAVA NAT: A Non-Autoregressive Translation Model with Look-Around Decoding and Vocabulary Attention
Table 5: BLEU score on IWSLT2014 En→De translation task. We apply look-around(LA) for each NAT model to show its effectiveness.
['[BOLD] IWSLT 2014 De-En  [BOLD] Model', '[BOLD] IWSLT 2014 De-En  [BOLD] origin', '[BOLD] IWSLT 2014 De-En  [BOLD] origin+LA']
S6SS0SSS0Px4 Effect of the Proposed Method for Other NAT Models In order to further test the effectiveness of the proposed look around(LA) mechanism, we incorporate LA into other NAT models on the IWSLT2014 De→En dataset. The LA mechanism succeeds in modeling local word orders inside the sentence, resulting in better translating performances.