Self-Balanced Dropout
Table 4: BLEU scores on WMT 2014 En-De dataset.
['Model', 'BLEU (case-sensitive)']
Although Transformer has a very deep structure and a large number of parameters, Self-Balanced Dropout works effectively and gains an improvement.