Simple and Effective Multi-Paragraph Reading Comprehension
Table 3: Published TriviaQA results. We advance the state of the art by about 15 points both test sets.
['Model', 'All EM', 'All F1', 'Verified EM', 'Verified F1']
We use the shared-norm approach for evaluation on the TriviaQA test set. We found that increasing the paragraph size to 800 at test time, and re-training the model on paragraphs of size 600, was slightly beneficial, allowing our model to reach 66.04 EM and 70.98 F1 on the dev set. Note that human annotators have estimated that only 75.4% of the question-document pairs contain sufficient evidence to answer the question Joshi et al. However, the score of 83.7 F1 on the verified set suggests that there is still room for improvement.