Achieving Human Parity on AutomaticChinese to English News Translation
Table 3: System combination results on the WMT 2017 Chinese-English test set
['[BOLD] SystemID', '[BOLD] Settings', '[BOLD] BLEU']
We experiment with system combination of n-best lists generated from various systems discussed above with 8 hypothesis from each system. We have experimented with many configurations and features for systems combination, we found out that the most helpful scoring features are: SYSScore, LMScore, R2Lscore, R2LSV and E2ZSV. This is quite surprising since the combined systems were focusing on modeling similar features. This may be due to the fact that the models are learning complimentary features, so they have extra capacity for complementing each other.