Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter
Table 8: BLEU scores on En-Tr test set with left-to-right generation. Normal translation is denoted as “0”, and teacher-forcing translation is denoted as “1”.
['[EMPTY]', '0', '1']
For the left-to-right decoding, the accuracy of the left half is higher than that of the right half in the normal translation. However, the accuracy of the right half becomes higher with teacher forcing translation. This demonstrates that English-Turkish translation performs similar to English-Japanese translation as the accuracy of right half is higher than that of the left half. But different from what we observed in Japanese, Turkish shows the opposite phenomenon: the influence of language branching is weaker than error propagation.