Gated Group Self-Attention for Answer Selection
Table 2. Comparison with LSTM and global self-attention on insuranceQA when using max-pooling or attention as composition module.
['Model (insuranceQA)', 'Test1', 'Test2']
Effectiveness of GGSA Block Firstly, we aim to prove that our proposed model GGSA as an encoder block can outperform LSTM and global self-attention. The comparison is performed in the cases of using max-pooling and attention as composition module. Because QA-LSTM and global self-attention have no interaction between questions and answers before upper structure, we don’t compare them with iGGSA. We can find that even GGSA can outperform these two baselines, which proves the effectiveness of GGSA.