FlauBERT: Unsupervised Language Model Pre-training for French
Table 3: Accuracy on the CLS dataset for French.
['Model', 'Books', 'DVD', 'Music']
The results highlight the importance of a monolingual French model for text classification: both CamemBERT and FlauBERT outperform mBERT by a large margin. FlauBERT\textscbase performs moderately better than CamemBERT in the books dataset, while its results on the two remaining datasets of DVD and music are lower than those of CamemBERT. FlauBERT\textsclarge achieves the best results in all categories.