Incorporating Both Distributional and Relational Semantics in Word Representations
Table 2: Analogy Test results: Comparison of single and joint objective embeddings. For a random baseline, accuracy=.31 and correlation=.018. (Jurgens et al., 2012).
['Embedding', 'Accuracy', 'Correlation']
GD by itself also achieves comparable scores, with 0.42 accuracy and 0.28 correlation. It is interesting to note that independent distributional and relational objectives achieve similar results for this task. The joint objective does not appear to help in this task, however. E.g., GD+NLM does not outperform GD; while NTN+NLM outperforms NTN, it does not outperform NLM.