Unsupervised Neural Machine Translation with Weight Sharing
Table 4: The experiments on the number of layers for encoders and decoders.
['layer num', 'en-de', 'de-en']
To determine the number of layers for encoders and decoders in our system beforehand, we conduct experiments on English-German translation tasks to test how the amount of layers in encoders and decoders affects the translation performance. We can find that the translation performance achieves substantial improvement with the layer number increasing from 2 to 4. However, with layer number set larger than 4, we get little improvement. To make a trade-off between the translation performance and the computation complexity, we set the layer number as 4 for our encoders and decoders.