On Improving Informativity and Grammaticality for Multi-Sentence Compression
Table 5: The effects of the improvements separately
['[BOLD] Metric', '[BOLD] Synonymy', '[BOLD] Merg/Map', '[BOLD] POS-LM', '[BOLD] All']
To investigate the impact of each improvement separately, we have also conducted separate experiments over the prepared dataset. In our work, merging and mapping strategies significantly increase the informativity of the compressions. So, their computed scores by Rouge are higher than the score of POS-LM. However, the combination of MWE merging and mapping gets a slightly lower score from Rouge-su4. One reason may be that usage of synonymy only for MWEs and ignoring other one-word synonym mapping causes a more diverse graph, which slightly decreases the informativity and grammaticality of compressed sentences. Meanwhile, POS-LM gets better scores from Bleu-4, which indicates the grammaticality enhancement rather than the informativity.