Capsule-Transformer for Neural Machine Translation
Table 2: Effect in encoder and decoder.
['[BOLD] #', '[ITALIC] Layers', '[BOLD] BLEU']
S4SS3SSS0Px1 Effect on Transformer Componets To evaluate the effect of capsule routing SAN in encoder and decoder , we perform an ablation study. Especially the modified decoder still outperforms the baseline even we have removed the vertical routing part, which demonstrates the effectiveness of our model. The row 4 proves the complementarity of the encoder and decoder with capsule routing SAN.