Relative Positional Encoding for Speech Recognition and Direct Translation
Table 1: ASR: Comparing our best models to other hybrid and end-to-end systems on the 300h SWB training set and Hub5’00 test sets. Absolute best is bolded, our best is italicized. WER↓ .
['[BOLD] Hyb.', '[BOLD] Models [povey2016purely] BLSTM+LFMMI', '[BOLD] SWB 9.6', '[BOLD] w/ SA –', '[BOLD] CH 19.3', '[BOLD] w/ SA –']
It is important to clarify that spectral augmentation (dubbed as SpecAugment) is a recently proposed augmentation method that tremendously improved the regularization ability of seq2seq models for speech recognition [park2019specaugment]. In better demonstrate the effect of relative attention, we conduct experiments with and without augmentation.