Read + Verify: Machine Reading Comprehension with Unanswerable Questions
Table 4: Comparison of readers with different answer verifiers.
['Configuration', 'All EM', 'All F1', 'NoAns ACC']
The combination of base reader with any answer verifier can always result in considerable performance gains, and combining the reader with Model-III obtains the best result. We find that the improvement on no-answer accuracy is significant. This metric raises from 73.1 to 77.1 after adding Model-III to RMR, increasing by 4 absolute points. Similar observation can be found when ELMo embeddings are used, demonstrating that the gains are consistent and stable.