Improving Multi-Head Attention with Capsule Networks
Table 2: Case-sensitive BLEU scores for En→De translation.
['[BOLD] En→De', '# Para.', 'BLEU']
In this experiment, we have applied our proposed methods both on the Base and Big model. The results show that our model can still outperform the baseline model, indicating the universality of the proposed approach.