Injecting Hierarchy with U-Net Transformers
Table 4: Comparison of U-Net Transformer against different baselines in the domain of machine translation. We select the WMT2014 English-German dataset and report test cross entropy and BLEU score for each model. As HRED, VHRED and VHCR are formatted for the dialogue domain, they are not included here.
['Architecture', 'Test Cross Entropy', 'BLEU Score']
Even in this domain, less suited for hierarchical structure of the U-Net, our model outperforms the best baseline by a BLEU point.