Learning to Compute Word Embeddings On the Fly
Table 2: Results on SNLI and MultiNLI. X/Y means X percent accuracy on the development set and Y percent accuracy on the test set. “dict” stands for “dictionary”.
['[EMPTY]', 'SNLI', 'MultiNLI matched', 'MultiNLI mismatched']
Using dictionary definitions allows us to bridge ≈40% of the gap between training from scratch and using embeddings pretrained on 840 billion words, and this improvement is consistent on both datasets. Compared to the SQuAD results, an important difference is that spelling was not as useful on SNLI and MultiNLI.