Denoising based Sequence-to-Sequence Pre-training for Text Generation
Table 9: Ablations for pre-trained encoder and decoder on CoNLL-2014 test set.
['System', '[ITALIC] P', '[ITALIC] R', '[ITALIC] F0.5']
The pre-trained encoder (−3.42 drop in F0.5) is more important than the pre-trained decoder (−2.42 drop in F0.5).