Retrieving Multi-Entity Associations: An Evaluation of Combination Modes for Word Embeddings
Table 1. Average prc@1 for the event completion task for all modes and all embedding models of size 200. The implicit network baseline achieves an average prc@1 of 0.330.
['[EMPTY]', 'skip-gram', 'CBOW', 'GloVe']
In order to compare the word vector combination modes, we first focus our evaluation on their performance in the event completion task. We observe that the combination modes perform similarly across the different embeddings, where both SUM and AVG perform comparably well in terms of recall, albeit worse than the implicit network baseline. MINMAX, CWMIN, CWMAX and CWMULT perform considerably worse and do not reach a recall above 0.6 at rank 10, unlike the other combination modes. We thus focus on SUM as a combination mode in the following.