Deep Neural Machine Translation with Linear Associative Unit
Table 1: Case-insensitive BLEU scores on Chinese-English translation.
['SYSTEM', 'MT03', 'MT04', 'MT05', 'MT06', 'AVE.']
Clearly DeepLAU leads to a remarkable improvement over their competitors. Compared to DeepGRU, DeepLAU is +4.89 BLEU score higher on average four test sets, showing the modeling power gained from the liner associative connections. We suggest it is because LAUs apply adaptive gate function conditioned on the input which make it able to automatically decide how much linear information should be transferred to the next step.