Data Augmentation for BERT Fine-Tuningin Open-Domain Question Answering
Table 2: Results on SQuAD
['Model', 'EM', 'F1', 'R']
The row marked “SRC” indicates fine tuning with SQuAD data only and matches the BERTserini condition of Yang et al. As expected, fine tuning with augmented data improves effectiveness, and experiments show that while training with positive examples using DS(+) definitely helps, an even larger boost comes from leveraging negative examples using DS(±). In both these cases, we only fine tune BERT with the augmented data, ignoring the source data.