Exploring phrase-compositionality in skip-gram models
Table 2: Comparison of word-level tasks, including word similarity, analogy.
['[EMPTY]', 'word353', 'men', 'SYN', 'MIXED']
On the WordSim-353 task, \newciteneelakantan-EtAl:2014:EMNLP2014 reported a Spearman’s correlation of 0.709, while their word2vec baseline is 0.704. For syntactic and mixed analogy tasks which involves syntax information, we can see that using phrase-level skip-gram and positional information both help and combining both gives the best performance.