A Simple Yet Strong Pipeline for HotpotQA
Table 2: HotpotQA’s fullwiki setting, Test set. The bottom-most model uses a larger language model than Quark.
['QA Model', 'Answer EM', 'Answer F1', 'Support EM', 'Support F1', 'Joint EM', 'Joint F1']
While we rely on retrieval from SR-MRS semanticmrs for our initial paragraphs, we outperform the original work. We attribute this improvement to two factors: our sentence selection capitalizing on the sentence’s paragraph context leading to better support selection, and a better span selection model leading to improved QA.