Logographic Subword Model for Neural Machine Translation
Table 3: In the task of Chinese-English translation, the BPE approach cannot identify subwords in Chinese logograms and consequently hurts the final BLEU score.
['[BOLD] PrePr', '[BOLD] NN(Mb)', '[BOLD] T(hr)', '[BOLD] t(ms)', '[BOLD] BLEU']
BPE cannot identify subwords in Chinese logograms. Consequently, it hurts the final BLEU score. Our approaches fit better to logographic languages in this direction. In the direction from English to Chinese, we did not observe the proposed models are better than BPE-based models.