Transformer ASR with Contextual Block Processing
Table 1: Word error rates (WERs) in the WSJ evaluation task with Lblock=16 and Lhop=8.
['[EMPTY]', 'eval92']
5.2.1 Comparison of recognition performance We first carried out a word error rate (WER) comparison on the WSJ dataset. For the batch encoding, we observed that the Transformer outperformed the conventional biLSTM model. It degraded when each biLSTM was swapped with a LSTM. input and PE + Max input). The proposed contextual block processing methods using PE and Avg. input improved the accuracy significantly, among which the combination (PE + Avg. input) achieved the best result.