A Common Semantic Space for Monolingual and Cross-Lingual Meta-Embeddings
Table 3: English Word Similarity results
['[EMPTY]', 'Av', 'Rel', 'Sim']
All these meta-embeddings also use our OOV approach (NN). In general, the concatenation scores are significantly better than the ones of the best pre-trained word embeddings used in the concatenation. Concatenating pre-trained embeddings outperform meta-embeddings created by averaging or by dimensionality reduction. Dimensionality reduction obtains slightly better results than averaging, but at the cost of much more computational effort.