A Sentence Compression Based Framework to Query-Focused Multi-Document Summarization
Table 7: Sentence compression comparison. The true c rate is 69.06% for the test set. Tree-based approaches all use single-scorer. Our context-aware and head-driven tree-based approaches outperform all the other systems significantly (p<0.01) in precision (Uni-Prec) without sacrificing the recalls (i.e. there is no statistically significant difference between our models and McDonald (2006) / M & S (2009) with p>0.05). Italicized numbers for unigram F1 (Uni-F1) are statistically indistinguishable (p>0.05). Our head-driven tree-based approach also produces significantly better grammatical relations F1 scores (Rel-F1) than all the other systems except the rule-based method (p<0.01).
['[BOLD] System', '[BOLD] C Rate', '[BOLD] Uni-Prec', '[BOLD] Uni-Rec', '[BOLD] Uni-F1', '[BOLD] Rel-F1']
based on a paired t-test. Unigram F1 scores (Uni-F1) in italics indicate that the corresponding systems are not statistically distinguishable (p>0.05). For grammatical relation evaluation, our head-driven tree-based system obtains statistically significantly (p<0.01) better F1 score (Rel-F1 than all the other systems except the rule-based system).