Deep Neural Machine Translation with Linear Associative Unit
Table 3: English-to-French task: BLEU scores of single neural models.
['SYSTEM', 'BLEU']
Luong et al. Luong et al. The two attention models, RNNSearch and RNNsearch-LV achieve BLEU scores of 28.5 and 32.7 respectively. The previous best single NMT Deep-Att model with an 18 layers encoder and 7 layers decoder achieves BLEU score of 35.9. For DeepLAU, we obtain the BLEU score of 35.1 with a 4 layers encoder and 4 layers decoder, which is on par with the SOTA system in terms of BLEU. Note that Zhou et al. Zhou et al.