Transferable Neural Projection Representations
Table 1: Similarity Tasks: # of params, 100k vocabulary size for skipgram baseline, 100 embedding size.
['[ITALIC] Dataset', '[ITALIC] SG (10M)', '[ITALIC] NP-SG (w/oOP)', '[ITALIC] NP-SG (1M)', '[ITALIC] NP-SG (2M)', '[ITALIC] NP-SG (4M)']
Results: NP-SG gets better representations even with misspellings which cannot be handled by vanilla SG.