Constituency Parsing with a Self-Attentive Encoder
Table 9: Learning rates.
['Language', 'Base Learning Rate']
Our model was trained using Adam with a batch size of 250 sentences. Development-set performance was evaluated four times per epoch; if it did not improve for 5 epochs in a row the learning rate was halved. The iterate that performed best on the development set was taken as the output of the training procedure.