DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs
Table 6: Dev set performance breakdown by different answer types; our model (NAQANet, marked as QN+) vs. BERT, the best-performing baseline.
['[BOLD] Type', '(%)', '[BOLD] Exact Match QN+', '[BOLD] Exact Match BERT', '[BOLD] F1 QN+', '[BOLD] F1 BERT']
The best performance is obtained by our NAQANet model. Future work may also try combining our model with BERT. Furthermore, we find that all heuristic baselines do poorly on our data, hopefully attesting to relatively small biases in DROP.