Attention-Guided Answer Distillation for Machine Reading Comprehension
Table 3: Comparison of different approaches on the NarrativeQA test set using summaries: Kadlec20161, Seo172 and Tay20183. (E: ensemble model)
['Model', 'Bleu-1', 'Bleu-4', 'Rouge-L']
the student’s performance can still be boosted using our approach, even outperforming the teacher in terms of Bleu-1 score.