Revisiting Round-Trip Translation for Quality Estimation
Table 5: Pearson correlations of Bleu and RTT-based QE metrics where FT systems are SMT and NMT. We reveal the number of systems in parenthesis.
['Language Pairs', 'Systems (n)', 'Pearson correlations Bleu', 'Pearson correlations RTT-Bleu', 'Pearson correlations RTT-chrF', 'Pearson correlations RTT-SBert', 'Pearson correlations RTT-BERTScore']
A certain type of FT system could be penalized by one metric according to its computation method. For this reason, we observe the performance of RTT-based QE metrics on different FT systems: SMT and NMT. SMT denotes the systems submitted to WMT12 and NMT represents the systems submitted to WMT19.