Detecting and ordering adjectival scalemates Paper presented at MAPLEX 2015, February 9-10, Yamagata, Japan (http://lang.cs.tut.ac.jp/maplex2015/)
Table 2: Pair counts for each similarity measure, along with MPQA evaluation scores (percentage correct) for each similarity measure–filtering method combination.
['Method', 'Filter', '# Pairs', '# Test', 'Score']
The table shows big differences in the amount of results between the different similarity measures. Whereas we get 1533 results using Roget’s thesaurus, our LSA-based method produces nearly ten times as many pairs of scalemates. The pattern-based method turns out to have a very high recall, with 32,470 different pairs of adjectives. Out of all these pairs, 2,611 scalemates have contrasting subjectivity measures in the MPQA database. 1,590 (60.9%) of these pairs are correctly predicted to be in ⟨weak, strong⟩ order. A two-tailed Fisher’s exact test reveals that the difference between our results and Potts’ \shortcitepotts2011developing data is not statistically significant (p=0.1547).