Contrastive Attention Mechanism for Abstractive Sentence Summarization
Table 4: The effect of dropping Po (denoted by -Po) from Transformer+ContrastiveAtt during decoding.
['Gigaword', 'R-1', 'R-2', 'R-L']
We study the contribution of the opponent probability Po by dropping it during decoding to see if it hurts the performance. The performance difference between the model dropping Po and the baseline Transformer is marginal, indicating that adding the opponent probability Po is key for achieving the performance improvement.