Meta-Embedding as Auxiliary Task Regularization
Table 3: SS-MTL Embedding Analogy Transferability
['[EMPTY]', 'MSR', 'Google', 'SemEval']
Here, we analyse (1) whether the word meta-embeddings carry over to analogy even if not all embedding algorithms preserve analogy relations, (2) check if the similarity encoded with SS-MTL has any effect on performance on analogy and (3) check whether the nonlinearity induced by autoencoding, performs relatively well (somewhat counter-intuitively, given the existence of linear relationships between analogy pairs [allen2019analogies]) for analogy reasoning.