A Simple Yet Strong Pipeline for HotpotQA
Table 1: HotpotQA’s distractor setting, Dev set. The bottom two models use larger language models than Quark.
['QA Model', 'Answer EM', 'Answer F1', 'Support EM', 'Support F1', 'Joint EM', 'Joint F1']
Moreover, we are within 1 point of models that use RoBERTa embeddings—a much stronger language model that has shown improvements of 1.5 to 6 points in previous HotpotQA models.