Correlation-based Intrinsic Evaluation of Word Vector Representations
Table 3: Pearson’s correlations between word similarity/qvec/qvec-cca scores and the downstream text classification tasks.
['[EMPTY]', '[BOLD] 20NG', '[BOLD] Metaphor', '[BOLD] Senti']
To test the efficiency of qvec-cca in capturing the semantic content of word vectors, we evaluate how well the scores correspond to the scores of word vector models on semantic benchmarks. qvec-cca obtains high positive correlation with all the semantic tasks, and outperforms qvec on two tasks.