EmpTransfo: A Multi-head Transformer Architecture for Creating Empathetic Dialog Systems
Table 2: Summary of the results on DailyDialog evaluation set.
['[BOLD] Model', '[BOLD] Hit@1 ↑', '[BOLD] PPL ↓', '[BOLD] F1 ↑', '[BOLD] BLEU ↑']
A conversation is a sequence of utterances and each utterance can be more than one sentence, but the emotion and action information are defined per utterance. We also add distractors to each sample in the dataset. In the table, the row highlighted in red with the number d shows a distractor. With more contextual features Hit@1 and PPL are improved. Transformer ranker model has a greater F1 and BLEU compared to other models which is expected because those metrics give higher scores for stronger similarity with the golden utterances in the datasets. The reason behind this observation is that more contextual information provides the model with better information on selecting the correct next sentence and correct next token.