Reading Wikipedia to Answer Open-Domain Questions
Table 6: Full Wikipedia results. Top-1 exact-match accuracy (in %, using SQuAD eval script). +Fine-tune (DS): Document Reader models trained on SQuAD and fine-tuned on each DS training set independently. +Multitask (DS): Document Reader single model trained on SQuAD and all the distant supervision (DS) training sets jointly. YodaQA results are extracted from https://github.com/brmson/yodaqa/wiki/Benchmarks and use additional resources such as Freebase and DBpedia, see Section 2.
['[BOLD] Dataset', '[BOLD] YodaQA', '[BOLD] DrQA SQuAD', '[BOLD] DrQA +Fine-tune (DS)', '[BOLD] DrQA +Multitask (DS)']
Despite the difficulty of the task compared to machine comprehension (where you are given the right paragraph) and unconstrained QA (using redundant resources), DrQA still provides reasonable performance across all four datasets.