Out of the Echo Chamber:Detecting Countering Debate Speeches
Table 3: Experimental results on the test set for each method and experimental setting: The average accuracy of the top prediction (A) and the average mean reciprocal rank (M) of the true counter with the highest score. The methods are ordered by their M score in the All setting. The last row (Rand) shows the accuracy of the random baseline.
['[BOLD] Method', '[ITALIC]  [BOLD] All  [BOLD] A', '[ITALIC]  [BOLD] All  [BOLD] M', '[ITALIC]  [BOLD] Explicit  [BOLD] A', '[ITALIC]  [BOLD] Explicit  [BOLD] M', '[ITALIC]  [BOLD] Implicit  [BOLD] A', '[ITALIC]  [BOLD] Implicit  [BOLD] M']
These results show that there is a large performance gap between the implicit and explicit settings – in favor of the latter – for all methods (except BERT), suggesting it is an easier setting. This is consistent with the results of our annotation experiment.