SpanBERT: Improving Pre-training by Representingand Predicting Spans
Table 1: Test results on SQuAD 1.1 and SQuAD 2.0.
['[EMPTY]', 'SQuAD 1.1 EM', 'SQuAD 1.1 F1', 'SQuAD 2.0 EM', 'SQuAD 2.0 F1']
SpanBERT exceeds our BERT baseline by 2.0% and 2.8% F1 respectively (3.3% and 5.4% over Google BERT). In SQuAD 1.1, this result accounts for over 27% error reduction, reaching 3.4% F1 above human performance.