You Impress Me: Dialogue Generation via Mutual Persona Perception
Table 3: Variant analysis results on Persona-Chat revised mode, along with relative improvements (shown inside brackets) compared with P2 \textscBot-S. BLEU refers to the cumulative 4-gram BLEU score. “- Persona” means dialogue generation without personas; “- Next” ablates the auxiliary task mentioned in Section 3.1; “+ RS.1” means only using Language Style score as the reward in the self-play fine-tuning phase; “↪ + RS.2” means adding Discourse Coherence to the reward on the basis of RS.1; “↪ + RS.3” is equivalent to our proposed P2 \textscBot.
['Variant', 'Hits@1(%)\u2009↑', 'F1(%)\u2009↑', 'BLEU(%)\u2009↑']
We conducted variant analysis on P2 \textscBot to investigate the influence of RS.1, RS.2 and RS.3. Another metric BLEU Papineni et al. As expected, the results on Hits@1 validate the important role of the auxiliary task. Across all the variants, the gains in BLEU and F1 are very small, revealing the difficulty in improving them. Nevertheless, solely by adding RS.3, we obtained a 25% relative improvement on BLEU, indicating the effectiveness of our proposed mutual persona perception. Similar conclusions can be drawn from the trend of F1.