On Faithfulness and Factuality in Abstractive Summarization
Table 9: Spearman’s correlation coefficient (|rs|) of different metrics with faithful and factual annotations.
['[BOLD] Metric', '[BOLD] Faithful', '[BOLD] Factual']
Overall, all neural text generation systems are getting better in generating repetition-free and coherent single-sentence summaries of news articles. Transformer-based models, TranS2S and BertS2S in particular, perform superior to RNN-based PtGen and CNN-based TConvS2S models.