FRAGE: Frequency-Agnostic Word Representation
Table 3: BLEU scores on test set on WMT2014 English-German and IWSLT German-English tasks.
['[BOLD] WMT En→De  [BOLD] Method', '[BOLD] WMT En→De  [BOLD] BLEU', '[BOLD] IWSLT De→En  [BOLD] Method', '[BOLD] IWSLT De→En  [BOLD] BLEU']
Machine Translation We outperform the baselines for 1.06/0.71 in the term of BLEU in transformer_base and transformer_big settings in WMT14 English-German task, respectively. The model learned from adversarial training also outperforms original one in IWSLT14 German-English task by 0.85. These results show improving word embeddings can achieve better results in more complicated tasks and larger datasets.