Don’t Neglect the Obvious:On the Role of Unambiguous Words in Word Sense Disambiguation
Table 3: Uninformed WSD results of the LMMS model using SemCor (SC) and UWA with different example thresholds. Models tested on the concatenation of all WSD datasets of raganato-etal-2017-word. As before, UWA is concatenated with SC in this experiment.
['[BOLD] Corpus', '[BOLD] BERT  [BOLD] F1', '[BOLD] BERT  [BOLD] P@5', '[BOLD] BERT  [BOLD] MRR', '[BOLD] RoBERTa  [BOLD] F1', '[BOLD] RoBERTa  [BOLD] P@5', '[BOLD] RoBERTa  [BOLD] MRR']
As can be observed, low number of examples, such as 2, already achieves the best overall results. More generally, in this setting the differences with respect to SemCor are more marked. This is expected as the propagation algorithm has a stronger effect in this setting where all sense embeddings are considered.