Multi-agent Learning for Neural Machine Translation
Table 3: BLEU score on IWSLT 2014 German-English translation. KD-4 stands for ensemble knowledge distillation with four agents. Dual-5 is the SOTA model from the work of Wang et al. (2019). And Rel-4 is our best model (Rel) training with four diverse agents.
['Task', '[ITALIC] L2R', '[ITALIC] Rel', 'KD-4', 'Dual-5', 'Rel-4']
We work with the IWSLT German-English translation to compare our model to the SOTA model. and Rel-4 models achieve the best result on this dataset (35.53 and 36.27), which manifests the effectiveness of using multiple agents.