Better Rewards Yield Better Summaries: Learning to Summarise Without References
Table 4: Human evaluation on extractive summaries. Our system receives significantly higher human ratings on average. “Best%”: in how many percentage of documents a system receives the highest human rating.
['[EMPTY]', 'Ours', 'Refresh', 'ExtAbsRL']
Table 4 presents the human evaluation results. summaries generated by NeuralTD receives significantly higher human evaluation scores than those by Refresh (p = 0.0088, double-tailed ttest) and ExtAbsRL (p (cid:28) 0.01). Also, the average human rating for Refresh is significantly higher (p (cid:28) 0.01) than ExtAbsRL,