Learning to Search for Dependencies
Table 4: Performance of different base learning algorithms with the L2S parser on PTB corpus.
['Base Leaner', 'Dev UAS', 'Dev LAS', 'Test UAS', 'Test LAS']
The Value of Strong Base Learners. L2S allows us to leverage well studied classification methods. We show the performance when training with base learners using the following update rules. Unless stated otherwise all the base learners are cost-sensitive multiclass classifiers. SGD: stochastic gradient descent updates. SGD+: NN: a single-hidden-layer neural network with 5 hidden nodes. NN + FTRL: a neural network learner with follow-the-regularized-leader regularization (the base learner in the above experiments). Multiclass: a multiclass classifier using NN+FTRL update rules. The gold label is given by the dynamic oracle.