Self-Attentive Residual Decoder for Neural Machine Translation
Table 4: BLEU scores for two scoring variants of the attention function of the proposed decoder.
['[BOLD] Attention function', '[BOLD] BLEU  [BOLD] En-Zh', '[BOLD] BLEU  [BOLD] Es-En']
We now examine the two scoring functions that can be used for the self-attentive residual connections model presented in Eq. the best option is the content matching function, which depends only on the word embeddings. The content+scope function, which depends additionally on the hidden representation of the current prediction is better than the baseline but scores lower than content.