A Simple Language Model forTask-Oriented Dialogue
Table 10: Ablations on MultiWOZ 2.1 comparing different ways to represent TOD as a single sequence. Performance on all metrics drops without   and   tokens.
['End token', 'User/System token', 'Joint Acc', 'Inform', 'Success', 'BLEU', 'Combined']
S5SS0SSS0Px4 We were surprised that end tokens such as  improved performance, but analysis revealed that without them, SimpleTOD tended to generate much longer belief state, action, and response generations. Even more important is clearly differentiating user and system text for SimpleTOD.