One Representation per Word — Does it make Sense for Composition?
Table 7: Results on a subsample of the 2-sense noun subtask across frequency bands.
['[BOLD] Noun - 2 Senses, context window size = 2  [BOLD] Frequency Band', '[BOLD] Noun - 2 Senses, context window size = 2 <10 [ITALIC] k', '[BOLD] Noun - 2 Senses, context window size = 2 10 [ITALIC] k [BOLD]  – 50 [ITALIC] k', '[BOLD] Noun - 2 Senses, context window size = 2 ≥50 [ITALIC] k']
All methods outperform the random and word overlap baseline and appear to be working better for less frequent lexemes. One possible explanation for this behaviour is that less frequent lexemes have fewer senses and potentially less subtle sense differences than more frequent lexemes, which would make them easier to discriminate by distributional semantic methods.