Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering
Table 11: Effects of the question-dependent paragraph encoding: Comparing our retriever model with and without the query-dependent encoding. For our question-dependent approach, the full wiki results correspond to “retriever, no link-based negatives” in Table 7, and the distractor results correspond to “Ours (Reader: BERT wwm)” Table 1, to make the results comparable.
['Encoding method', 'full wiki ( [ITALIC] F=100) QA F1', 'full wiki ( [ITALIC] F=100) QA EM', 'distractor QA F1', 'distractor QA EM']
As seen in this table, the QA F1 and EM performance significantly deteriorates on the full wiki setting, which demonstrates the importance of the question-dependent encoding for complex and entity-centric open-domain question answering.