A Joint Many-Task Model:Growing a Neural Network for Multiple NLP Tasks
Table 9: Effectiveness of the Successive Regularization (SR) and the Vertical Connections (VC).
['[EMPTY]', 'JMTall', 'w/o SR', 'w/o VC']
We can see that the accuracy of chunking is improved by the successive regularization, while other results are not affected so much. The chunking dataset used here is relatively small compared with other low-level tasks, POS tagging and dependency parsing. Thus, these results suggest that the successive regularization is effective when dataset sizes are imbalanced.