Multi-Domain Neural Machine Translation with Word-Level Adaptive Layer-wise Domain Mixing
Table 6: BLEU Scores of Domain Mixing + Domain Aware Embedding for Chinese-to-English Task
['Method', 'Laws', 'News', 'Speech', 'Thesis']
The embedding based methods can be naturally combined with our domain mixing methods. The computation of the gradient, on the other hand, is the key to combining two methods. Specifically, we encourage the embedding to be domain aware via MTL, AdvL and PAdvL, where we use the domain proportion layers to guide the training of the embedding. Here we consider applying domain mixing only to the encoder as the baseline. As can be seen, by applying appropriate domain aware embedding, the performance can be further improved.