Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting
Table 4: The comparison of different data augmentation methods for FST.
['[BOLD] Model', '[BOLD] E&M', '[BOLD] F&R']
Compared with back translation, the improvements of formality discrimination and multi-task transfer are more significant since they introduce new rewriting knowledge and valuable training signals. The combination of the augmented data further improves the performance, obtaining more than 2.5 absolute improvement over the baseline trained with only original data.