Sequence Training of DNN Acoustic Models With Natural Gradient
Table 4: %WER differences between different optimisers on dev.sub with 158k vocabulary bigram/trigram LMs on dev.sub (200 hr).
['LM', 'SGD', 'HF', 'DSAG-HF', 'NG']
It can be seen again that the NG method results in lower WERs than SGD or the HF variants.