Microsoft Research Asia’s Systems for WMT19
Table 3: BLEU scores on Chinese→English test sets.
['System', 'newstest17', 'newstest18']
S3SS3SSS0Px4 Results We list two baseline Transformer_big systems which use 18M bilingual data (constraint) and 56M bilingual data (unconstraint) respectively. The pre-trained model achieves about 1 BLEU point improvement after fine-tuning on both 18M and 56M bilingual data. After iterative back translation (BT) and knowledge distillation (KD), as well as re-ranking, our system achieves 30.8 and 30.9 BLEU points on newstest2017 and newstest2018 respectively.