A Unified Query-based Generative Model for Question Generation and Question Answering
Table 4: Results on the “description” subset of MS-MARCO.
['Models', 'ROUGE-L']
For the generative QA experiment, we compare our model with the generative models in Nguyen et al. on the “description” subset of MS-MARCO dataset. Among all the comparing methods, Best Passage selects the best passage in terms of the ROUGE-L score, and obviously it accesses the reference. Passage Ranking ranks the passage by a deep structured semantic model of Huang et al. We also implement a baseline system “vanilla-cosine”, which only apply the vanilla cosine similarity for the matching function fm in our encoder, and is only trained with the cross-entropy loss.