Multilingual Speech Recognition with a Single End-to-End Model
Table 3: WER(%) of joint LAS model and the joint language-conditioned models, namely decoder-conditioned (Dec), encoder-conditioned (Enc), and encoder+decoder-conditioned (Enc + Dec).
['Language', 'Joint', 'Dec', 'Enc', 'Enc + Dec']
The encoder-conditioned model (Enc) is better than the decoder-conditioned model (Dec) indicating that some form of acoustic model adaptation towards different languages and accents occurs when the encoder is conditioned. In addition, conditioning both the encoder and decoder (Enc + Dec) does not improve much over conditioning just the encoder, suggesting that feeding the encoder with language ID information is sufficient, as the encoder outputs are then fed to the decoder anyways via the attention mechanism.