Sequence Prediction with Neural Segmental Models
Table 5.1: Frame error rates (FER) and phoneme error rates (PER) on the development set comparing the CNN and the LSTM encoder.
['[EMPTY]', 'FER (%)', 'PER (%)']
The LSTM performs better than the CNN for both tasks. We suspect that the LSTM’s superior performance is due to the training approaches: the LSTM is trained on entire utterances, while the CNN is trained on batches of 15-frame windows. For the rest of the experiments, we use 3-layer LSTMs as our encoders.