Compositional Questions Do Not Necessitate Multi-hop Reasoning
Table 1: F1 scores on HotpotQA. * indicates the result is on the validation set; the other results are on the hidden test set shown in the official leaderboard.
['[BOLD] Model', '[BOLD] Distractor F1', '[BOLD] Open F1']
the question was written for (gold paragraphs) with eight spurious paragraphs selected using TF-IDF similarity with the question (distractors). Our single-paragraph BERT model achieves 67.08 F1, comparable to the state-of-the-art This indicates the majority of HotpotQA questions are answerable in the distractor setting using a single-hop model. We use the single-paragraph BERT model trained in the distractor setting. We also fine-tune the model using incorrect paragraphs selected by the retrieval system. In particular, we retrieve 30 paragraphs and select the eight paragraphs with the lowest yempty scores predicted by the trained model. This shows that the open-domain setting is challenging for our single-hop model and is worthy of future study.