Goal-Oriented Multi-Task BERT-Based Dialogue State Tracker
Table 2: Performance comparison between the baseline and our model on the dev set, and our model’s scores on the test set.
['[EMPTY]', '[BOLD] Active Int Acc', '[BOLD] Req Slot F1', '[BOLD] Avg GA', '[BOLD] Joint GA']
A plausible explanation for the significantly higher active intent score of the baseline model is that it uses the [CLS] token output for intent predictions. We also tried to employ the [CLS] token output for the intent classifier and got better scores for intent accuracy. But at the same time, joint goal accuracy degraded.