Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answering
Table 4: Impact on justification selection F1-performance from the hyper parameter Qr of AIR (eq. 5).
['[ITALIC] Qr', 'MultiRC F1 score', 'QASC Both Found', 'QASC One Found']
This is because the candidate justifications are coming from a relatively small numbers of paragraphs in MultiRC; thus even shorter queries (=2 words) can retrieve relevant justifications. On the other hand, the number of candidate justifications in QASC is much higher, which requires longer queries for disambiguation (>=4 words).