Large Scale Question Answering using Tourism Data
Table 6: Test set performance (Acc@3 in %) of ablation systems on questions with different candidate answer space sizes.
['[BOLD] Candidate Space Size', '[BOLD] No. of Questions', 'CsQA', 'CrQA', 'CsrQA']
In questions where the candidate space is relatively smaller (<1000), we find CrQA model has slightly better performance than the CsQA model. However, in large candidate spaces we find the CsQA model is more effective in pruning the candidate search space and performs better than the CrQA model. The CsrQA model outperforms both systems regardless of candidate space size, highlighting the benefit of our method.