Large-Scale QA-SRL Parsing
Table 3: Precision and recall of our annotation pipeline on a merged and validated subset of 100 verbs. The unfiltered number represents relaxing the restriction that none of 2 validators marked the question as invalid.
['[EMPTY]', 'P', 'R', 'F']
In order to further analyze the quality of our annotations relative to He et al. Interestingly, re-adding the questions rejected in the validation step greatly increases recall with only a small decrease in precision, showing that validators sometimes rejected questions considered valid by the authors.