Memory-Augmented Neural Networks for Machine Translation
Table 2: Romanian→English translation results (BLEU) on dev (newsdev2016) and test (newstest2016) sets. M.A.D ↔ Memory-Augmented Decoder. 1 R/W head means the MANN had 1 read and 1 write head into external memory.
['[BOLD] Model', '[BOLD] Dev', '[BOLD] Test']
The proposed extensions to the attentional encoder-decoder result in 0.3-0.9 lower test set BLEU score. For the Romanian→English translation task, the pure MANN model has 1.5-1.9 lower test set BLEU score.