Supervised Phrase-boundary Embeddings
Table 4: Comparison of Word2vec with SPhrase(NU) on Conll2003 English and Wikigold dataset
['Model', 'Conll2003Eng', 'Wikigold']
The Conll dataset is widely used to evaluate various NER based models. It contains 203,621 tokens in the training set, while validation and test set contains 51,362 and 46,435 tokens respectively. On the other hand, Wikigold provides a single data file of 39,007 tokens that we used for testing while the NER models were trained with Conll train and validation data. We trained this in 20 epochs with evaluating on validation data each time. We performed 10 instances for each of these models and presented the range of F1 scores (using Conll2003 evaluation script).