Dual Learning: Theoretical Study and an Algorithmic Extension
Table 5: Experimental Results on MultiUN (2M bilingual data)
['[EMPTY]', 'Vanilla', 'Dual', 'Multi-step']
We can see that on average, dual learning can boost the six baselines (i.e., standard transformer) by 0.55 point. Although dual learning can achieve very high scores on MultiUN translation tasks, our proposed multi-step dual learning can still improve it by 0.41 point on average.