ERNIE: Enhanced Language Representation with Informative Entities
Table 3: Results of various models on Open Entity (%).
['Model', 'P', 'R', 'F1']
From the table, we observe that: (1) BERT and ERNIE achieve much higher recall scores than the previous entity typing models, which means pre-training language models make full use of both the unsupervised pre-training and manually-annotated training data for better entity typing. (2) Compared to BERT, ERNIE improves the precision by 2% and the recall by 2%, which means the informative entities help ERNIE predict the labels more precisely.