Neural Headline Generation with Sentence-wise Optimization
Table 5: Comparison with baseline systems on DUC-2004 and Gigaword English test sets. G-RNN stands for Gated Recurrent Neural Networks, enc and dec are shorts for encoder and decoder respectively.
['System', 'Training', 'Model Architecture', 'DUC-2004  [ITALIC] R1 [ITALIC] R', 'DUC-2004  [ITALIC] R2 [ITALIC] R', 'DUC-2004  [ITALIC] RLR', 'Gigaword  [ITALIC] R1 [ITALIC] F1', 'Gigaword  [ITALIC] R2 [ITALIC] F1', 'Gigaword  [ITALIC] RLF1']
These results indicate that NHG model with MLE achieves comparable performance to existing headline generation systems. Moreover, replacing MLE with MRT significantly and consistently improves the performance of NHG model, and outperforms the state-of-the-art systems on both test set.