TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding
Table 3: SQuAD development results for two versions of base TRANS-BLSTM models.
['Model', 'EM', 'F1']
We note that these two models lead to similar accuracy on this dataset. We will use TRANS-BLSTM-2 to report the accuracy in the rest of the experiments (denoted as TRANS-BLSTM for notational simplicity).