Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering
Table 2: Performance on QA task on hidden test set of HotpotQA after adding the retrieved paragraphs
['Model', 'EM', 'F1']
We were able to achieve better scores than reported in the baseline reader model of yang2018hotpotqa by using Adam kingma2014adam instead of standard SGD (our re-implementation). Next, we use the top-10 paragraphs retrieved by our system from the entire corpus and feed it to the reader model. We achieve a 10.59 absolute increase in F1 score than the baseline. It should be noted that we use the simple baseline reader model and we are confident that we can achieve better scores by using more sophisticated reader architectures, e.g. using Bert based architectures. Our results show that retrieval is an important component of an open-domain system and equal importance should be given to both the retriever and reader component.