Reduce, Reuse, Recycle:New uses for old QA resources.
Table 2: Accuracy on the challenge test set of models trained on SQuAD and the UWRE and UWRE+ entity split data.
['Training Data', 'Acc']
Although the original UWRE model achieved an F1 of around 90% on the unmodified entity split test set, here it only manages to get 2% of its predictions correct. In contrast, the modified UWRE+ training data results in a model that is much more accurate, predicting over 70% of the negative examples correctly. Nonetheless, the performance of the SQuAD trained model is stronger still, even without modification to address this problem.