Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answering
Table 11: Ablation test on attention components of ET-RR on ARC. ‘–’ denotes the ablated feature.
['Model', 'Test']
Attention components. As shown, ET-RR with all attention components performs the best on the ARC test set. The performance of ET-RR without passage-question attention drops the most significantly out of all the components. It is worth noting that the choice interaction layer gives a further 0.24% boost on test accuracy.