A Summarization System for Scientific Documents
Table 1: Tasks results for section-agnostic, and section-based. † - The results were significant with p<0.05. ‡- The results were significant with p<0.005.
['Task', 'Section-agnostic % wins', 'Section-agnostic Avg. score (std)', 'Section-based % wins', 'Section-based Avg. score (std)']
For example, for task (2), for 68% of the papers, the section-based summary was scored higher, while, for 22% the section-agnostic summary was scored higher (for 10% of the papers, the summaries were scored equally). The average score for section-based summaries was 3.32 with standard deviation of 0.53. Notably, the quality of the section-based summaries significantly outperforms the section-agnostic summaries on all 3 tasks, supporting our proposed paradigm.