All Word Embeddings from One Embedding
Table 3: Results on DUC 2004 task 1. The scores in bold are superior to the previous top score.
['Method', '[ITALIC] Dinter', 'Embed', 'R-1', 'R-2', 'R-L']
This table indicates that ALONE (Real number) achieved the comparable ROUGE-2 score to the previous best in Dinter=512. In addition, Transformer+LRPE+PE+ALONE in Dinter=1024 outperformed the previous best score except for ROUGE-2 in ALONE (Binary) despite the embedding parameter size being one-eighth of that of the original Transformer+LRPE+PE.