A novel repetition normalized adversarial reward for headline generation
Table 2: Results of different models on f-score for different ROUGE measures and repetition rate. The larger ROUGE score and smaller repetition rate implies better results.
['[BOLD] models', '[BOLD] ROUGE-1', '[BOLD] ROUGE-2', '[BOLD] ROUGE-L', '[BOLD] repetition-rate']
We report f-score for ROUGE-1, ROUGE-2, ROUGE-L on the test set. The baseline Pointer-Gen-Coverage model achieves 24.68 ROUGE-1 score, 10.92 ROUGE-2 score, 21.78 ROUGE-L score, and repetition-rate of 9.54%. When applying ROUGE score alone as the reward, ROUGE-1 score increases to 28.65, and ROUGE-L increases to 23.89. However, the repetition-rate also increases to 13.42%, which shows that using ROUGE alone as reward improves the performance but also introduces more repetitions.