ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training
Table 7: n-gram comparison results on CNN/DailyMail test set
['Setting', 'R-1', 'R-2', 'R-L']
The pre-trained models are then fine-tuned on CNN/DailyMail. We report the F1 scores of ROUGE-1, ROUGE-2 and ROUGE-L. We can see that the performance of ProphetNetbase-3gram and ProphetNetbase-2gram is comparable. Both of them perform better than MASSbase and ProphetNetbase-1gram. Considering the computational and time cost, we use ProphetNetbase-2gram in experiments of the main body of our paper due to its training speed is 15% faster than ProphetNetbase-3gram.