Exploiting stance hierarchies for cost-sensitivestance detection of Web documents
Table 8. Confusion matrix of different stages.
['Stage1', 'Unrelated', 'Unrelated 17,668', 'Related 681']
We note the increasing difficulty of each stage. Stage 1 misclassifies a small number of related instances as unrelated (less than 8%). Stage 2 misclassifies 29% of the stance instances as neutral. Finally, stage 3 misclassifies the majority of disagree instances (55%) as agree, and around 25% of the agree instances as disagree. It is evident from these results that there is much room for improvement for the last stage of our pipeline.