Revealing the Importance of Semantic Retrieval for Machine Reading at Scale
Table 1: Results of systems on HotpotQA.
['[BOLD] Method', 'Ans EM', 'Ans F1', 'Sup EM', 'Sup F1', 'Joint EM', 'Joint F1']
More specifically, the biggest improvement comes from the EM for the supporting fact which in turn leads to doubling of the joint EM on previous best results. The scores for answer predictions are also higher than all previous best results with ∼8 absolute points increase on EM and ∼9 absolute points on F1. All the improvements are consistent between test and dev set evaluation.