Question Answering through Transfer Learning from Large Fine-grained Supervision Data
Table 8: Comparison of performance of SQuAD-T-pretrained model (SQuAD-T-Y) and SQuAD-pretrained model (SQuAD-Y) on WikiQA.
['Pretrained dataset SQuAD-T-Y', 'Pretrained dataset SQuAD-Y', 'total', 'Category Id 1', 'Category Id 2', 'Category Id 3', 'Category Id 4', 'Category Id 5', 'Category Id 6']
It shows that span supervision clearly helps answering questions on Category 1 and 2, which are easier to answer, with answering correctly on most of the questions in Category 1. Similarly, we show the comparison of the performance on classified examples of the model without pretraining and SQuAD-pretrained model on SemEval-2016. It also shows that span supervision helps answering questions asking information or opinion/recommendation.