charagram: Embedding Words and Sentences via Character n-grams
Table 6: Performance (Pearson’s r×100) as a function of the number of unknown words in the sentence pairs over all 20 SemEval STS datasets. N is the number of sentence pairs.
['Number of Unknown Words', '[ITALIC] N', 'paragram-phrase', 'charagram-phrase']
One of our primary motivations for character-based models is to address the issue of out-of-vocabulary (OOV) words, which were found to be one of the main sources of error for the paragram-phrase model from \newcitewieting-16-full. They reported a negative correlation (Pearson’s r of -0.45) between OOV rate and performance. We took the 12,108 sentence pairs in all 20 SemEval STS tasks and binned them by the total number of unknown words in the pairs. We computed Pearson ’s r over each bin.