What-if I ask you to explain:Explaining the effects of perturbations in procedural text
Table 6: Confusion matrix for di (left) and de overall (right). (gold is on x-axis, predicted on y-axis.)
['[EMPTY]', '\\vbox \\scalebox{.5}{∙}', '[BOLD] +', '[BOLD] −']
di, de errors: When the model incorrectly predicts di, a major source of error is when ‘−’ is misclassified. 70% of the ‘−’ mistakes, should have been classified as ‘+’. A similar trend is observed for de but the misclassification of ‘− is less skewed.