Spoken SQuAD: A Study of Mitigating the Impact of Speech Recognition Errors on Listening Comprehension
Table 3: Performance comparison of training on text documents (full SQuAD Train Set, denoted as Text) and ASR transcriptions (Spoken SQuAD Train Set, denoted as Speech). The testing data is from Spoken SQuAD testing set (SpokenS-test) with ASR errors.
['[BOLD] Data', '[BOLD] Score', '[BOLD] BiDAF  [ITALIC] Text', '[BOLD] BiDAF  [ITALIC] Spoken', '[BOLD] Dr.QA  [ITALIC] Text', '[BOLD] Dr.QA  [ITALIC] Spoken']
We further trained BiDAF and Dr. QA on either SQuAD training set (text documents) or Spoken SQuAD training set (ASR transcriptions), and tested on the testing set of Spoken SQuAD. The results for training on text docuemtns are labelled with Text, while training on ASR transcriptions are labelled as Speech. However, when testing documents have ASR errors, models trained on ASR transcriptions are remarkably better than on text documents.