How multilingual is Multilingual BERT?
Table 2: Pos accuracy on a subset of UD languages.
['Fine-tuning \\ Eval', 'en', 'de', 'es', 'it']
We perform pos experiments using Universal Dependencies (UD) Nivre et al. We use the evaluation sets from Zeman et al. We see that M-Bert generalizes well across languages, achieving over 80% accuracy for all pairs.