Zero-Shot Cross-lingual Classification Using Multilingual Neural Machine Translation
Table 2: Zero-Shot performance on all French test sets. ∗Note that we use the English accuracy in the bridged column for SST.
['[BOLD] Model', 'Amazon (Fr) Bridged', 'Amazon (Fr) Zero-Shot', 'SST (Fr) Bridged∗', 'SST (Fr) Zero-Shot', 'SNLI (Fr) Bridged', 'SNLI (Fr) Zero-Shot']
It can be seen that just by using the pre-trained NMT encoder, the zero-shot performance increases drastically from almost random to within 10% of the bridged system. Freezing the encoder further pushes this performance closer to the bridged system. On the Amazon Review task, our zero-shot system is within 2% of the best bridged system. On the SST task, our zero-shot system obtains an accuracy of 83.14% which is within 1.5% of the bridged equivalent (in this case the English system).