Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehension
Table 5: Performance comparison of of BiDAF with various embeddings over Spoken SQuAD testing set
['[BOLD] MODEL', '[EMPTY]', '[BOLD] No noise EM', '[BOLD] No noise F1', '[BOLD] No noise AOS', '[BOLD] NoiseV1 EM', '[BOLD] NoiseV1 F1', '[BOLD] NoiseV1 AOS', '[BOLD] NoiseV2 EM', '[BOLD] NoiseV2 F1', '[BOLD] NoiseV2 AOS']
We compare the performance of the proposed subword unit sequence embedding with two strong baselines, word embedding and combination of word and character embedding. vs. (a)(b)). In addition, model which concatenates character, phoneme and syllable sequence embeddings together (row (e)) achieves the best performance across EM/F1/AOS over all kinds of WER ASR data.