Relation Module for Non-answerable Prediction on Reading Comprehension
Table 3: Prediction accuracies on answerable and non-answerable questions on development set.
['[EMPTY]', 'Answerable', 'Non-Answerable']
Since our relation module is designed to help a MRC model’s ability to judge non-answerable questions, we examine the accuracy when a question is answerable and when a question is non-answerable. The relation module improves prediction accuracy for both types of questions, and with more accuracy gain on the non-answerable questions: close to 4% gain on the non-answerable questions, which is more than 200 non-answerable questions are correctly predicted.