Construction of the Literature Graph in Semantic Scholar
Table 3: Results of the entity extraction model on the development set of SemEval-2017 task 10.
['Description', 'F1']
We use the standard data splits of the SemEval-2017 Task 10 on entity (and relation) extraction from scientific papers Augenstein et al. The first line omits the LM embeddings lmk, while the second line is the full model (including LM embeddings) showing a large improvement of 4.2 F1 points. The third line shows that creating an ensemble of 15 models further improves the results by 1.1 F1 points.