Computing Lexical Contrast
Table 12: Percentage of contrast questions correctly answered by the automatic method, where different questions sets correspond to different parts-of-speech.
['[EMPTY]', '# instances', 'P', 'R', 'F']
Observe that performances on all parts of speech are fairly high. The method deals with adverb pairs best (F-score of 0.89), and the lowest performance is for verbs (F-score of 0.80). The precision values obtained between on the data from any two parts of speech are not significantly different. However, the recall obtained on the adverbs is significantly higher than that obtained on adjectives, and the recall on adjectives is significantly higher than that obtained on verbs. The difference between the recalls on adverbs and nouns is not significant. We used the Fisher Exact Test and a confidence interval of 95% for all significance testing reported in this section.