Dissecting Content and Context in Argumentative Relation Analysis
Table 3: Argumentative relation classification models h,f,g with different access to content and context; models of type CI (content-ignorant) have no access to the EAU span. †: significantly better than mfs baseline (p<0.005); ‡ significantly better than content-based (p<0.005).
['model', 'T', 'F1 [ITALIC] sup', 'F1 [ITALIC] att', 'F1∅', 'macro F1']
Main results The results for all three prediction settings (one outgoing edge: h, support/attack: f and support/attack/ neither: g) across all type variables All models significantly outperform the majority baseline with respect to macro F1. Intriguingly, the content-ignorant models (CI) always perform significantly better than the models which only have access to the EAUs’ content (CB, p<0.005). In the most general task formulation (g), we observe that CI even significantly outperforms the model which has maximum access (seeing both EAU spans and surrounding contexts: FA).