Dependency or Span, End-to-End Uniform Semantic Role Labeling
Table 7: Dependency vs. Span-converted Dependency on CoNLL 2005, 2009 test sets with dependency evaluation.
['WSJ', 'J & N', 'Dep F1 85.93', 'Span-converted F1 84.32', 'Δ F1 1.61']
We do not train new models for the conversion and the resulted comparison. Instead, we do the job on span-style CoNLL 2005 test set and dependency-style CoNLL 2009 test set (WSJ and Brown), considering these two test sets share the same text content. As the former only contains verbal predicate-argument structures, for the latter, we discard all nomial predicate-argument related results and predicate disambiguation results during performance statistics.