A recurrent neural network without chaos
Table 3: Experiments on Penn Treebank with dropout.
['Model', 'Size', 'Training', 'Val. perp.', 'Test perp.']
Experiments with Dropout. The dropout rate p and q are chosen as follows: For the experiments with 20M parameters, we set p=55% and q=45% for the CFN and p=60% and q=40% for the LSTM; For the experiments with 50M parameters, we set p=65% and q=55% for the CFN and p=70% and q=50% for the LSTM.