RikiNet: Reading Wikipedia Pages for Natural Question Answering
Table 2: Ablations of DPDA reader on dev set of NQ dataset.
['Setting', 'LA F1', 'SA F1']
We keep the predictor and remove the component of the DPDA reader. The results are shown in Tab. In (e) and (f), we remove the paragraph attention mask of Eq. We can see that after removing the DPDA reader, the performance drops sharply. In addition, the paragraph dynamic self-attention layer has the greatest impact on performance. Moreover, both the paragraph attention mask and dynamic attention mask contribute to the performance improvement.