Bi-Decoder Augmented Network for Neural Machine Translation
Table 2: BLEU scores on WMT14 English-to-French for Transformer results.
['[BOLD] NMT Models', '[BOLD] En→De', '[BOLD] De→En']
However, the improvement from reinforcement learning is quite modest, while the denoising part even declines the scores. We conjecture that this is because the positional encoding of the Transformer reduces the order dependency capture of the model, thus counteracts the effects of these approaches.