Effective Use of Transformer Networks for Entity Tracking
Table 9: Model’s performance degradation with input ablations. We see that the model’s major source of performance is from verbs than compared to other ingredient’s explicit mentions.
['[BOLD] Input', '[BOLD] Accuracy']
We only observe a minor performance drop from 84.59 to 82.71 (accuracy) when other ingredients are removed entirely. Removing verbs dropped the performance to 79.08 and further omitting both leads to 77.79. This shows the model’s dependence on verb semantics over tracking the other ingredients.