Training Millions of Personalized Dialogue Agents
Table 3: Retrieval precision on the Reddit test set using a Transformer and different persona selection systems. N: maximum number of sentences per persona.
['[ITALIC] N', 'Persona selection', 'hits@1']
, we report precision results for several persona extraction setups. The rules setup improves the results somewhat, however adding the persona classifier actually degrades the results. A possible interpretation is that the persona classifier is trained only on the Persona-chat revised personas, and that this selection might be too narrow and lack diversity. Increasing the maximum persona size also improves the prediction performance.