Denoising based Sequence-to-Sequence Pre-training for Text Generation
Table 3: ROUGE scores for CNN/Daily Mail dataset.
['System', 'ROUGE 1', 'ROUGE 2', 'ROUGE L']
Results for CNN/Daily Mail “rnn-ext+RL” combines both extractive and abstractive methods and achieves performance improvements chen2018fast. PoDA is a purely abstractive summarization system and performs stably better than all the methods. “PoDA w/o pre-training” only has moderate success with ROUGE-1 40.82, ROUGE-2 18.46 and ROUGE-L 37.61. When combined with pre-training, PoDA establishes new state-of-the-art on CNN/Daily Mail dataset.