Google’s Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation
Table 3: Many to Many: BLEU scores on various data sets for single language pair and multilingual models.
['Model', 'Single', 'Multi', 'Diff']
We see that the multilingual production models with the same model size and vocabulary size as the single language models are quite close to the baselines – the average relative loss in BLEU score across all experiments is only approximately 2.5%.