Improvements to Deep Convolutional Neural Networks for LVCSR
Table 13: WER on Broadcast News, 400 hrs
['model', 'dev04f', 'rt04']
While the proposed 512-hybrid CNN-based feature system did improve (14.1 WER) over the old CNN (14.8 WER), performance slightly deteriorates after CNN-based features are extracted from the network. However, the 5,999-hybrid CNN offers between a 13-16% relative improvement over the DNN hybrid system, and between a 4-5% relative improvement over the old CNN-based features systems. This helps to strengthen the hypothesis that hybrid CNNs have more potential for improvement, and the proposed fMLLR and ReLU+dropout techniques provide substantial improvements over DNNs and CNNs with a sigmoid non-linearity and VTLN-warped log-mel features.