What the [MASK]?Making Sense of Language-Specific BERT Models
Table 1: Summary of average performance of different language-specific BERT models on various tasks.
['[BOLD] Task', '[BOLD] Metric', '[BOLD] Avg. lang-specific BERT', '[BOLD] Avg. mBERT', '[BOLD] Diff.']
The results clearly show that on average, language-specific BERT models obtain higher results with respect to mBERT in all the considered tasks. However, while this holds for averages, with the proliferation of languages, tasks, and data sets, there is a huge variation in the individual performances. In the following, we analyze the possible views of the collected results in more detail.