Universal Neural Machine Translation for Extremely Low Resource Languages
Table 2: Scores over variant source languages (6k sentences for Ro & Lv, and 10k for Ko). “Multi" means the Multi-lingual NMT baseline.
['Src', 'Aux', 'Multi', '+ULR', '+ MoLE']
To have a fair comparison, we use only 6k sentences corpus for both Ro and Lv with all the settings and 10k for Ko. It is obvious that applying both the universal tokens and mixture of experts modules improve the overall translation quality for all the language pairs and the improvements are additive.