Sequence Prediction with Neural Segmental Models
Table 7.4: Real-time factors for decoding comparing CTC and segmental models.
['[EMPTY]', 'regular LSTM', 'pyramid LSTM']
Pyramid LSTMs trained with CTC are the best performer while also being the most efficient to train. Due to smaller and simpler search spaces, frame-based LSTMs trained with CTC decode faster than segmental models. While frame-based LSTMs train and decode faster, segmental models are more flexible, so they might be improved with additional feature functions. Explicitly hypothesizing segments can serve as a prior, so segmental models might perform better in low-resource settings.