Explaining Question Answering Models through Text Generation
Table 3: Human-evaluation results for how reasonable hypotheses are (CSQA development set). Each rater determined whether a hypothesis is reasonable (1 point), somewhat reasonable (0.5 point) or not reasonable (0 points). The score is the average rating across raters and examples.
['Model', 'Score']
Top-K=5 ST achieved the highest score of 0.74. While SupGen models produce more natural texts, they are judged to be less reasonable in the context of the question.