Transformer Transducer: A Streamable Speech Recognition Model with Transformer Encoders and RNN-T LossThis is the final version of the paper submitted to the ICASSP 2020 on Oct 21, 2019.
Table 5: Limited left context per layer for label encoder.
['Audio Mask left', 'Audio Mask right', 'Label Mask left', 'WER (%) Test-clean', 'WER (%) Test-other']
In addition, we evaluated how the left context used in the T-T LabelEncoder affects performance. It shows very limited left context for label encoder is good engough for T-T model. We see a similar trend when limiting left label states while using a full attention T-T audio encoder.