A Generative Approach to Titling and Clustering Wikipedia Sections
Table 4: Partial correlations between Rouge-L and extractive score, controlled for length. All values are statistically significant.
['Trans', 'Rnn', 'Rnn+Sc', 'Rnn+Attn']
For all models, the resulting correlations are positive, indicating that they generate extractive headings better than non-extractive headings. However, the correlations for the Trans and Rnn+Attn models are highest. Overall, these results suggest that decoders with attention mechanisms achieve high performance on this task because they better copy tokens from the input into the output, rather than because they encode more semantics.