DiscoFuse: A Large-Scale Dataset for Discourse-Based Sentence Fusion
Table 10: Fusion results on WebSplit, measured by SARI and the F1 scores that compose it.
['Training data', '[ITALIC] SARI', 'Keep', 'Add', 'Delete']
Pre-training with DfWiki improves SARI score by 9% compared to using WebSplit alone. In particular, the F1 of the ‘kept’ and ‘added’ n-grams is significantly higher, by 23% and 33% respectively. Specifically, ‘added’ tokens refer also to correctly choosing discourse connectives, to which the large-scale examples in DiscoFuse were likely helpful.