Entity, Relation, and Event Extraction with Contextualized Span Representations
Table 7: In-domain pre-training: SciBERT vs. BERT
['[EMPTY]', 'SciERC Entity', 'SciERC Relation', 'GENIA Entity']
Table 7 compares the results of BERT and SciBERT with the best-performing model configurations. SciBERT significantly boosts performance for scientific datasets including SciERC and GENIA.