Substitute Based SCODE Word Embeddings in Supervised NLP Tasks
Table 8: NER Results for Word Embeddings. The ones in bold fonts are the highest scores in their columns.
['[BOLD] Word Embeddings', '[BOLD] Development', '[BOLD] Test', '[BOLD] OOD']
The baseline system does not use word embeddings as features. All of the word embeddings significantly improve the baseline system. SCODE embeddings trained on RCV1 corpus achieves the best score on test set and Out of Domain Test (OOD) set. Note that RCV1 corpus is the superset of NER training and test data. Thus, C&W, HLBL and SCODE on RCV1 embeddings are from the same data source.