Dual Conditional Cross-Entropy Filtering of Noisy Parallel Corpora
(e) Sum of all sub-tasks
['System', 'Avg-BLEU']
It seems that systems are ranked by their average score across these test sets and sub-tasks. The shared task overview will likely include a more thorough analysis. We place highest out of 48 submissions in three out of four tasks (SMT 100M, NMT 10M and NMT 100M) and third out of 48 for sub-task SMT 10M. The systems are packed quite closely, but the overall total across all four tasks shows, that we accumulate a slightly larger margin over the next best systems while the next four systems barely differ. This result is better than we expected as we only optimized for the NMT 100M task.