Guiding attention in Sequence-to-sequence models for Dialogue Act prediction
Table 5: Accuracy on the dev set of seq2seq model trained with sequence level loss. Btrain stands for the beam size during training, Binf for the one during inference88footnotemark: 8.For SwDA, Wilcoxon test (10 runs with different seeds) has been performed for Btrain=2 and Binf=2 against all other models. For RMDA, Wilcoxon test has been performed (10 runs with different seeds) for Btrain=5 and Binf=1 against all model with Btrain=2.
['[height=20pt] [ITALIC] Binf [ITALIC] Btrain', 'SwDA 2', 'SwDA 5', 'RMDA 2', 'RMDA 5']
Fine tuning with a sequence loss: As previously mentioned, using beam search during inference only leads to a limited improvement in accuracy.