Pairwise Neural Machine Translation Evaluation
Table 4: Kendall’s tau (\tau) on the WMT12 dataset for alternative architectures using 4metrics+syntax25+Wiki-GW25 as input.
['[BOLD] Details', '[BOLD] Kendall’s \\tau  [BOLD] cz', '[BOLD] Kendall’s \\tau  [BOLD] de', '[BOLD] Kendall’s \\tau  [BOLD] es', '[BOLD] Kendall’s \\tau  [BOLD] fr', '[BOLD] Kendall’s \\tau  [BOLD] AVG']
We can see that switching from our multi-layer architecture to a single-layer one yields an absolute drop of 0.6 \tau. This suggests that there is value in using the deeper, pairwise layer architecture.