Text Understanding with the Attention Sum Reader Network
Table 6: Dimension of the recurrent hidden layer and of the source embedding for the best model and the range of values that we tested. We report number of hidden units of the unidirectional GRU; the bidirectional GRU has twice as many hidden units.
['Dataset', 'Rec. Hid. Layer min', 'Rec. Hid. Layer max', 'Rec. Hid. Layer best', 'Embedding min', 'Embedding max', 'Embedding best']
The hyperparameters, namely the recurrent hidden layer dimension and the source embedding dimension, were chosen by grid search. We started with a range of 128 to 384 for both parameters and subsequently kept increasing the upper bound by 128 until we started observing a consistent decrease in validation accuracy.