Joint Training of Candidate Extraction and Answer Selection for Reading Comprehension
Table 6: Different number of extracted candidates results in different final performance on the test set of Quasar-T.
['[BOLD] Quasar-T', '[BOLD] EM', '[BOLD] F1']
S4SS4SSS0Px3 Effect of Candidate Number The candidate extraction stage takes an important role to decide what information should be focused on further. Therefore, we also test the influence of different K when extracting candidates from each passage. Taking K=1 degrades the performance, which conforms to the expectation, as the correct candidates become less in this stricter situation. However, taking K=3 can not improve the performance further. Although a larger K means a higher possibility to include good answers, it raises more challenges for the selection model to pick out the correct one from candidates with more varieties.