Memory-enhanced Decoder for Neural Machine Translation
Table 2: MemDec performances of different memory size.
['pre-training', '[ITALIC] n', 'MT03', 'MT04', 'MT05', 'MT06', 'Ave.']
Pre-training plays an important role in optimizing the memory model. Our model is rather robust to the memory size: with merely four cells, our model will be over 2 BLEU higher than RNNsearch⋆. This further verifies our conjecture the the external memory is mostly used to store part of the source and history of target sentence.