A Joint Many-Task Model:Growing a Neural Network for Multiple NLP Tasks
Table 12: Effects of the character embeddings.
['Single', 'W&C', 'Only W']
Character n-gram embeddings The column of “W&C” corresponds to using both of the word and character n-gram embeddings, and that of “Only W” corresponds to using only the word embeddings. These results clearly show that jointly using the pre-trained word and character n-gram embeddings is helpful in improving the results. The pre-training of the character n-gram embeddings is also effective; for example, without the pre-training, the POS accuracy drops from 97.52% to 97.38% and the chunking accuracy drops from 95.65% to 95.14%.