Concept Pointer Network for Abstractive Summarization
Table 1: ROUGE F1 evaluation results on the Gigaword and ROUGE recall on DUC-2004 test set. The results with † mark are taken from the corresponding papers. Underlined scores are the best without additional optimization. Bold scores are the best between the two optimization strategies. ⋆ mark indicates the improvements from the baselines to the concept pointer are statistically significant using a two-tailed t-test (p<0.01).
['Models', 'Gigaword RG-1', 'Gigaword RG-2', 'Gigaword RG-L', 'DUC-2004 RG-1', 'DUC-2004 RG-2', 'DUC-2004 RG-L']
We observe that our model outperformed all the strong state-of-the-art models on both datasets in all metrics except for RG-2 on Gigaword. In terms of the pointer generator performance, the improvements made by our concept pointer are statistically significant (p<0.01) across all metrics.