Early Stage LM Integration Using Local and Global Log-Linear Combination
Table 3: Comparing the effect of using a different LM for training and testing. Models trained with local fusion criterion except for the first block, which is CE.
['training LM', 'testing LM', 'dev WER [%] clean', 'dev WER [%] other']
4.2.2 Interchangeability of LM When we train the AM together with an LM then it learns to work together with the LM at decoding. Now we wonder if the AM learns to make use of LMs in general or if it is adapted to the specific LM we used in training. We therefore train our AM together with the LSTM LM and use it together with the transformer LM in decoding. Using the transformer LM with the local fusion criterion nicely stacks both improvements.