WERd: Using Social Text Spelling Variantsfor Evaluating Dialectal Speech Recognition
Table 5: Pearson correlations.
['[BOLD] Metrics Compared', '[BOLD] Correlation']
Pearson correlation. We further measured the correlation between WER/MR-WER vs. TER/WERd. We first calculated the scores for WER/MR-WER/TER/WERd for each of the 1,217 test utterances in isolation, and then we calculated the Pearson correlation using the corresponding lists of utterance-level scores. We can see that WERd correlates better than TER with both WER and also with MR-WER. Overall, we can conclude that WERd is a promising measure for evaluating ASR systems that target dialectal speech input.