Exploring Phoneme-Level Speech Representations for End-to-End Speech Translation
Table 4: Comparison of frame vs phoneme input on Spanish ASR, with average reduction in WER and average reduction in training time.
['[BOLD] Data', 'Frames  [BOLD] dev', 'Frames  [BOLD] test', 'Phonemes  [BOLD] dev', 'Phonemes  [BOLD] test', 'WER Δ', 'Time Δ']
To test whether the approach is a generally more effective input representation or only an aid in the particularly complex learning task of speech translation where it helps to reduce the distance between inputs and outputs, we apply our method to ASR, where are alignments are monotonic. We note that Weiss et al.