Concatenated Power Mean Word Embeddings as Universal Cross-Lingual Sentence Representations
Table 5: The performance of our average word embeddings with our projection method in comparison to other approaches. ‡We trained CCA on word-alignments extracted from TED transcripts using fast_align (i.e., CCA uses the same data source as our method).
['[BOLD] Model', '∑  [BOLD] X-Ling', '∑  [BOLD] In-Language']
However, in preliminary experiments, we found that our suggested approach produces considerably better cross-lingual word embeddings in our setup. Compared to the word-level projection method CCA we obtain substantially better cross-lingual sentence embeddings, and even stronger improvements when re-mapping AR embeddings, even though these are already bilingual.