BERTScore: Evaluating Text Generation with BERT
Table 10: Pearson correlations with human judgments on the MSR Abstractive Text Compression Dataset.
['Type', 'Metric', 'Meaning', 'Grammar', 'Combined']
A dataset and evaluation metrics for abstractive compression of sentences and short paragraphs. The data includes three types of human scores: (a) meaning: how well a compressed text preserve the meaning of the original text; (b) grammar: how grammatically correct a compressed text is; and (c) combined: the average of the meaning and the grammar scores. We follow the experimental setup of Toutanova et al. FBERT provides a balance between the two aspects.