Improvements to Deep Convolutional Neural Networks for LVCSR
Table 8: Pooling in Time
['Method', 'WER']
We see that pooling in time helps slightly with stochastic and lp pooling. However, the gains are not large, and are likely to be diminished after sequence training. It appears that for large tasks with more data, regularizations such as pooling in time are not helpful, similar to other regularization schemes such as lp/stochastic pooling and pooling with overlap in frequency.