Multilingual Neural Machine Translation with Task-Specific Attention
Table 8: BLEU scores for multilingual NMT ‘zero-shot’ translations comparing the baseline shared attention model to target-specific and source-specific attention models.
['shared', 'Fr-Es 13.64', 'Fr-Es 13.63', 'Fr-Es 13.75', 'Fr-De 7.82', 'Fr-De 8.04', 'Fr-De 7.84', 'From Fr']
Although the absolute numbers are lower (as expected for zero-shot pairs), our target-specific attention model gives gains of between +1.0 and +1.5 BLEU over the model that shares attention parameters across all languages. Source-specific attention does not work well for zero-shot translation.