Does Higher Order LSTM Have Better Accuracy for Segmenting and Labeling Sequence Data?
Table 2: The sizes of tag set of different order.
['[BOLD] Model', '[BOLD] All-Chunking', '[BOLD] English-NER', '[BOLD] Dutch-NER']
MO-BiLSTM also results in a growing size of tag set. The tag size of the model is beyond a hundred at order-3 case. Although the size of tag set grows as the order of model increases, it is acceptable in such sequence labeling problems compared to the vocabulary size in machine translation which can be over millions.