Learning to Embed Words in Context for Syntactic Tasks
Table 6: Tagging accuracies (%) on validation (Oct27Test) and test (Daily547) sets using all features: Brown clusters, tag dictionaries, name lists, and character n-grams. Last row is best result from Owoputi et al. (2013).
['[EMPTY]', 'val.', 'test']
After adding these features, we increase the hidden layer size to 2048. We use dropout, using a dropout rate of 0.2 for the input layer and 0.4 for the hidden layers. The other settings remain the same. Our new baseline tagger improves from 89.2% to 92.1% on validation, and improves further with updating.