Fast, Simpler and More Accurate Hybrid ASR Systems Using Wordpieces
Table 2: Effect of stride for wordpiece and chenone
['Unit', 'Criterion', 'Stride', '[ITALIC] LC-BLSTM', '[ITALIC] vggTrf']
In the first set of experiments, we investigate what is the best stride for different modeling units. For vggTrf model, striding is achieved by setting stride of max-pooling layers, e.g. a total stride of 8 can be achieved by setting stride equals 2 for all three VGG blocks. For LC-BLSTM, we apply subsampling factor of 2 for activation of the three consecutive hidden layers right after the first layer. We use 2K wordpiece size in this study.