Generating Persona-Consistent Dialogue ResponsesUsing Deep Reinforcement Learning
Table 3: The perplexity (PPL) of the pretrained GPT language model (Non-Dialogue LM) substantially improves after fine-tuning on dialogue utterances.
['[BOLD] Model', '[BOLD] PPL']
We observe a substantial improvement in perplexity, showing that the fine-tuned language model better captures the type of language used in dialogue utterances. This suggests that fine-tuning the language model on in-domain dialogue data could lead to a more suitable model for sub-reward R3.1.