Curriculum-based transfer learning for an effective end-to-end spoken language understanding and domain portability
Table 2: Performance of end-to-end SLU system with beam-search decoding with a 5-gram LM rescoring on the MEDIA test
['Training chain', 'CER', 'CVER']
Like for the Deep Speech 2 Baidu’s system, it is possible to apply a word-level language model (LM) rescoring through a beam search computed on the neural model outputs. By applying a such rescoring with a 5-gram LM trained on the MEDIA train set and on out-domain data (mainly from newspaper articles), results are significantly improved. As awaited, all results are improved and the curriculum-based transfer learning is still useful, making possible to reach 18.1% of CER and 22.1% of CVER.