Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT
Table 5: POS tagging. Kim et al. (2017) use small amounts of training data in the target language.
['lang', 'bg', 'da', 'de', 'en', 'es', 'fa', 'hu', 'it', 'nl', 'pl', 'pt', 'ro', 'sk', 'sl', 'sv', 'Average (-en)']
S5SS1SSS0Px4 Pos We use \newcitekim-etal-2017-cross as a reference. They utilized a small amount of supervision in the target language as well as English supervision so the results are not directly comparable. Interestingly, mBERT still outperforms \newcitekim-etal-2017-cross with 320 sentences in German (de), Polish (pl), Slovak (sk) and Swedish (sv).