Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
Table 12: Comparison of query formulation methods and amounts of retrieved evidence (i.e., top K) on the ARC dataset, in terms of percentage accuracy.
['Model', 'ET-RR (Concat)', 'ET-RR (Concat)', 'ET-RR (TF-IDF)', 'ET-RR (TF-IDF)', 'ET-RR', 'ET-RR']
Furthermore, only using TF-IDF to select essential terms in a question is not effective. When K=10, the ET-RR (TF-IDF) method performs even worse than ET-RR (Concat). This illustrates the challenges in understanding what is essential in a question.