Joint Training for Neural Machine Translation Models with Monolingual Data
Table 3: The BLEU scores (%) on Chinese↔English and English↔German translation tasks. For Chinese↔English translation, we list the average results of all test sets. For English↔German translation, we list the results of news-test2014.
['System', 'C→E', 'E→C', 'D→E', 'E→D']
JT-NMT (Iteration 1) can be considered as the general version of RNNSearch+M that any pseudo sentence pair is weighted as 1. Our approach will assign low weight to synthetic sentence pairs with poor translation, so as to punish its effect to the model update.