LAVA NAT: A Non-Autoregressive Translation Model with Look-Around Decoding and Vocabulary Attention
Table 2: The effect of using Bag-of-Words as targets.
['[BOLD] IWSLT14 De→En  [BOLD] Model', '[BOLD] IWSLT14 De→En  [BOLD] origin', '[BOLD] IWSLT14 De→En  [BOLD] origin+BOW']
We conduct experiments on IWSLT2014 De→En to verify its effectiveness. Incorporating various NAT models with “ +BOW” achieve consistent improvement in terms of BLEU score and this is in line with our expectation that sentence-level training objective can help to further boost the performance.