1 Introduction
Table 3: Accuracies for the natural language inference task. Shown are our implementations of a system without attention, and with logistic, soft, and sparse attentions.
['[EMPTY]', 'Dev Acc.', 'Test Acc.']
We observe that the soft and sparse-activated attention systems perform similarly, the latter being slightly more accurate on the test set, and that both outperform the NoAttention and LogisticAttention systems.