What-if I ask you to explain:Explaining the effects of perturbations in procedural text
Table 3: Accuracy of the explanation structure (i,j,di,de). Overall explanation accuracy is accexpl.
['[EMPTY]', '[ITALIC] acci', '[ITALIC] accj', '[ITALIC] accdi', '[ITALIC] accde', '[ITALIC] accexpl']
Quartet is also the best model on explanation accuracy. Quartet also outperforms baselines on every component of the explanation. Quartet performs better at predicting i than j. This trend correlates with human performance- picking on the second supporting sentence is harder because in a procedural text neighboring steps can have similar effects. Quartet not only improves QA accuracy but also the explanation accuracy. This shows that if a model is optimized for explanations, it leads to better performance on end-task. Thus, with this result we establish that (at least on our task) models can make better predictions when forced to generate a sensible explanation structure. An educational psychology study Dunlosky et al. However, their hypothesis is not conclusively validated due to lack of evidence.