Bag-of-Vector Embeddings of Dependency Graphs for Semantic Induction
Table 1: Pearson correlations between the gold STS scores and the scores \sc sts(S1,S2) between the BoVEs for the two sentences.
['Corpus', 'pairs', 'Bag of W2V', 'BoVE']
Semantic Textual Similarity (STS) Agirre et al. Most submissions to the STS tasks use supervised models that are trained and tuned on the provided training data or on similar datasets from earlier versions of the task, and many use additional knowledge resources (e.g. Sultan et al. We use this data in a fully unsupervised setting, where our only external resources are corpora of raw of parsed text. We use the STS-2014 data as a development set to evaluate BoVEs trained with a few different hyperparameters settings. The STS-2014 dataset consists of 6 subsets covering different domains, which we report separately, along with their average score. We then evaluated this one best model on the STS-2015 data. The STS-2015 dataset consists of 5 subsets covering different domains: answers-forums (Q&A in public forums), answers-students, belief, headlines (news headlines) and images (image captions). We report the standard evaluation measure provided within the SemEval-2015 Task 2 Agirre et al. These differences are not statistically significant.