FlauBERT: Unsupervised Language Model Pre-training for French
Table 7: Dependency parsing results.
['Model', 'UAS', 'LAS']
The best published results in this shared task [constant-2013] were involving an ensemble of parsers with additional resources for modelling multi word expressions (MWE), typical of the French treebank annotations. The monolingual French BERT models (CamemBERT, FlauBERT) perform better and set the new state of the art on this dataset with a single parser and without specific modelling for MWEs. One can observe that both FlauBERT models perform marginally better than CamemBERT, while all of them outperform mBERT by a large margin.