Pairwise Neural Machine Translation Evaluation
Table 2: Kendall’s \tau on WMT12 for neural networks using BLEUcomp, a decomposed version of BLEU. For comparison, the last line shows a combination using BLEU instead of BLEUcomp.
['[BOLD] System', '[BOLD] Details', '[BOLD] Kendall’s \\tau  [BOLD] cz', '[BOLD] Kendall’s \\tau  [BOLD] de', '[BOLD] Kendall’s \\tau  [BOLD] es', '[BOLD] Kendall’s \\tau  [BOLD] fr', '[BOLD] Kendall’s \\tau  [BOLD] AVG']
We see that using a single-layer neural network, which is equivalent to logistic regression, outperforms BLEU by more than +1 \tau points absolute.