Recipes for building an open-domain chatbot
Figure 12: Self-Chat ACUTE-Eval (engagingness) shows a small win (not significant) for using persona contexts after fine-tuning on the BST tasks.
['Generative BST 2.7B model Persona context', 'Generative BST 2.7B model vs.', 'Generative BST 2.7B model No context']
This context can both improve the bot’s consistency as well as add potential talking points that it can work into the conversation. To tease apart the impact of adding context vs. fine-tuning on BST but not using contexts at conversation time, we compared them against each other.