Task-Oriented Dialog Systems that Consider Multiple Appropriate Responses under the Same Context
Table 2: Comparison of response generation results on MultiWOZ. The oracle/generated denotes either using ground truth or generated results. The results are grouped according to whether and how system action is modeled.
['Model', 'Belief State Type', 'System Action Type', 'System Action Form', 'Inform (%)', 'Success (%)', 'BLEU', 'Combined Score']
Results are shown in Table 2. [CONTINUE] The first group shows that after applying our domain-adaptive delexcalization and domain-aware belief span modeling, the task completion ability of seq2seq models becomes better. [CONTINUE] The relative lower BLEU score [CONTINUE] Our DAMD model significantly outperforms other models with different system action forms in terms of inform and success rates, [CONTINUE] While we find applying our data augmentation achieves a limited improvement on combined score (6 vs 7), [CONTINUE] Moreover, if a model has access to ground truth system action, the model further improves its task performance.