Template-Based Question Generation from Retrieved Sentences for Improved Unsupervised Question Answering
Table 3: Effect of query and context matching for retrieved input to question generation module on downstream QA performance.
['Matching procedure', 'EM', 'F1']
Effect of filtering by entity matching: Besides ensuring that the retrieved sentence and query sentence share the answer entity, we require that at least one additional matching entity appears in both query sentence and entire context. Auxillary matching leads to improvements over no matching when using template-based data, with best results using matching with both query and context. Matching may filter some sentences whose topic are too far from the original context. We leave further investigation of the effect of retrieved sentence relevance to future work.