Frustratingly Easy Natural Question Answering
Table 4: Performance on NQ dev-test for varying aggregation strategies for duplicate answer spans (using greedy long answer search)
['Aggregation Strategy', 'SA F1', 'LA F1']
We find that using max aggregation results in the best short answer F1 whereas using normalized noisy-or aggregation results in the best long answer F1. Therefore, for our final submission, we use a combination strategy of producing short answer predictions using a greedy long answer search with max score for duplicate spans and long answer predictions using a greedy long answer search with noisy-or scores for duplicate spans.