BERTScore: Evaluating Text Generation with BERT
Table 16: Absolute Pearson correlations with system-level human judgments on WMT17 from-English translations. Correlations of metrics not significantly outperformed by any other for that language pair are highlighted in bold. For each language pair, we specify the number of systems.
['Setting', 'Metric', 'en-cs', 'en-de', 'en-lv', 'en-ru', 'en-tr', 'en-zh']
We experiment on the segment-level and system-level data on both to-English and from-English language pairs. We exclude fi-en data from the segment-level experiment due to an error in the released data. We compare our results to all participating metrics and perform standard significance testing as done by Bojar et al.