Sequence Prediction with Neural Segmental Models
Table 4.5: Real-time factors for decoding.
['[EMPTY]', '1st pass', '2nd pass', '3rd pass', 'total decoding', 'feeding forward', 'total overall']
Next we report on the speedups in training and decoding obtained with our proposed approach. In terms of decoding time alone, we achieve a factor of 2.4 speedup compared to the baseline. If the time of feeding forward LSTMs is included, then our proposed system is two times faster than the baseline.