ERNIE: Enhanced Language Representation with Informative Entities
Table 6: Results of BERT and ERNIE on different tasks of GLUE (%).
['Model', 'MNLI-(m/mm)', 'QQP', 'QNLI', 'SST-2']
We notice that ERNIE is consistent with BERTBASE on big datasets like MNLI, QQP, QNLI, and SST-2. The results become more unstable on small datasets, that is, ERNIE is better on CoLA and RTE, but worse on STS-B and MRPC.