Multi-Scale Self-Attention for Text Classification
Table 2: Test Accuracy on SST dataset.
['Model', 'Acc']
Multi-Scale Transformer achieves 1.5 and 3.56 points against Transformer on these two datasets, respectively. Meanwhile, Multi-Scale Transformer also beats many existing models including CNNs and RNNs.