ARedSum: Adaptive Redundancy-Aware Iterative Sentence Ranking for Extractive Document Summarization
Table 3: Average ranks of our best method and the best baseline on CNN/DailyMail and NYT50 in terms of informativeness (Info), redundancy (Rdnd) and the overall quality by human participants (the lower, the better).
['[BOLD] CNN/DailyMail', 'Info', 'Rdnd', 'Overall']
We also conduct human evaluations to analyze how our best model compares against the best baseline model. On both datasets, we randomly sample 20 summaries constructed by the best baseline and our best model from the cases where their Rouge-2 score difference is more than 0.05 points. Following Zhou et al. We allowed ties in the analysis.