Creation and Evaluation of Datasets for Distributional Semantics Tasks in the Digital Humanities Domain
Table 3: Harry potter Analogies dataset: Accuracy of various word embedding models on selected analogy task groups, and total accuracy.
['Task Section', 'first-', 'child-', 'husband-', 'wizard-', 'Total']
The independent evaluation of analogical reasoning with a dataset for the Harry Potter books supports most observations made on the ASOIF dataset. Again, the setting w2v-ww12-i15-hs with hierarchical softmax performs best, followed by GloVe. Our results confirm the findings of Ghannay et al. The score of CBOW-based models remains low.