Robust Neural Machine Translation with Doubly Adversarial Inputs
Table 9: Effect of the ratio value γsrc and γtrg on Chinese-English Translation.
['[13mm] [ITALIC] γsrcγtrg', '0.00', '0.25', '0.50', '0.75']
The hyper-parameters γsrc and γtrg control the ratio of word replacement in the source and target inputs. As we see, the performance is relatively insensitive to the values of these hyper-parameters, and the best configuration on the Chinese-English validation set is obtained at γsrc=0.25 and γtrg=0.50. We found that a non-zero γtrg always yields improvements when compared to the result of γtrg=0. While γsrc=0.25 increases BLEU scores for all the values of γtrg, a larger γsrc seems to be damaging.