Predicting ASR Performance on Unseen Broadcast Programs
Table 3: Regression vs CNNSoftmax predicted WERs (averaged over all utt.) per speaking style (NS/S) on Testpred
['[EMPTY]', 'NS', 'S', 'NS + S']
Overall, the predicted WER on non spontaneous (NS) and spontaneous (S) speech is very good for the CNN approach. WERPred is at -2.54% on non-spontaneous speech and at -4.84% on spontaneous speech. On the other hand, while efficient on non-spontaneous speech, regression fails to predict performance (-10,11%) on spontaneous speech.