A PDTB-Styled End-to-End Discourse Parser
Table 4: Overall results for the argument extractor.
['Partial', 'GS + no EP', 'Arg1  [ITALIC] F1 86.67', 'Arg2  [ITALIC] F1 99.13', 'Rel  [ITALIC] F1 86.24']
Miltsakaki et al. They found that most of the disagreements for exact match come from partial overlaps which do not show significant semantic difference. We follow such work and report both exact and partial matches. When checking exact match, we require two spans to match identically, excluding any leading and ending punctuation symbols. A partial match is credited if there is any overlap between the verbs and nouns of the two spans. The GS + no EP setting gives a satisfactory F1 of 86.24% for partial matching on relation level. On the other hand, the results for exact matching are much lower than the human agreement. We observe that most misses are due to small portions of text being deleted from or added to the spans by the annotators to follow the minimality principle to include in the argument the minimal span of text that is sufficient for the interpretation of the relation, which poses difficulties for machines to follow.