Comparative Analysis of Neural QA models on SQuAD
Table 1: Span and Sentence Level Performance
['[BOLD] Model', '[BOLD] BiDAF', '[BOLD] R-Net', '[BOLD] DrQA', '[BOLD] DocQA', '[BOLD] LR']
The span-level performance is measured typically by Exact Match (EM) and F1 metrics which are reported with respect to the ground truth answer spans. The DocQA model gives the best overall performance which aligns well with our expectation, owing to the usage of and improvements in the prior mechanisms introduced in BiDAF and R-Net.