Give your Text Representation Models some Love: the Case for Basque
Table 4: Basque POS tagging results on UD 1.2.
['[EMPTY]', '[BOLD] Word Accuracy']
Firstly, it can be seen that every BMC-trained model outperforms its official counterpart for all the three settings, albeit the difference between Flair-official and Flair-BMC is rather small. In any case, the results show the effectiveness of developing your own models for your own language. This is especially supported by the difference in performance obtained by BERTeus with respect to mBERT-official.