Normalization of Input-output Shared Embeddings in Text Generation Models
Table 4: BLEUs for DynamicConv models on IWSLT 14’ En-De dataset (De to En translation) with different embedding sharing techniques.
['Configuration', 'BLEU']
each method has close performance and the method of calculating cosine similarities is a slightly better than others, having a 0.41 BLEU improvement than baseline.