Automatic Summarization of Online Debates
Table 1: ROUGE scores derived from each feature in the Salient Sentence Selection task
['[BOLD] ROUGE-N', '[BOLD] CB', '[BOLD] CJ', '[BOLD] COS_CCT', '[BOLD] COS_TTS', '[BOLD] COS_TPS', '[BOLD] SL', '[BOLD] SP', '[BOLD] COS_STT', '[BOLD] TT']
4.1.1 Evaluation We used ROUGE-1, ROUGE-2, and ROUGE-SU4 evaluation metrics to evaluate the quality of the system summaries, i.e. the selection of salient sentences. As reference summaries we used the manually generated summaries from the freely available dataset, SSSD. Our results revealed that sentence position outperforms other features indicating that the most salient sentences are always. In addition, other useful key features are debate title words feature, and cosine similarity of debate title words and sentences feature.