Memory-Augmented Neural Networks for Machine Translation
Table 1: Vietnamese→English translation results (BLEU) on dev (TED tst2012) and test (TED tst2013) sets. M.A.D ↔ Memory-Augmented Decoder. 1 R/W head means the MANN had 1 read and 1 write head into external memory.
['[BOLD] Model', '[BOLD] Dev', '[BOLD] Test']
Interestingly, despite the pure MANN models seeing the source sentence in a uni-directional fashion (with all other models using bi-directional encoders) the pure MANN models perform on par with the other models.