Optimizing expected word error rate via sampling for speech recognition
Table 2: Word error rates for non-CTC 1-channel voice search model trained with sMBR and word-level EMBR.
['Test set', 'Num utts', 'WER sMBR', 'WER WEMBR', 'Relative']
In these experiments we used the same learning rate for sMBR and EMBR training since we were not yet fully aware of the mismatch in dynamic range; using a smaller learning rate may improve sMBR performance. We observed consistent gains from word-level EMBR training on this task.