Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks
Table 5: Accuracy on the XNLI test set of when fine-tuning Unicoder with one language and testing on other languages. The results in the diagonal correspond to the TRANSLATE-TRAIN accuracy reported in Table 2.
['TrainTest', 'en', 'fr', 'es', 'de', 'el', 'bg', 'ru', 'tr', 'ar', 'vi', 'th', 'zh', 'hi', 'sw', 'ur', 'average']
So as to better understand the relation between different languages, we fine-tune Unicoder on one language and test on all 15 languages.