Guiding Variational Response Generator to Exploit Persona
Table 1: Evaluation results on Douban corpus. uDist is the abbreviation for uDistinct in the table.
['Methods', 'BLEU', 'Embedding Average', 'Embedding Extreme', 'Embedding Greedy', 'Persona Metrics  [ITALIC] uRank', 'Persona Metrics  [ITALIC] uPPL', 'Persona Metrics  [ITALIC] uDist-1', 'Persona Metrics  [ITALIC] uDist-2']
We first report the performance on the Douban corpus. numbers in bold mean that the improvement on that metric is statistically significant over other methods (p-value \leq 0.01). It is observed that the BLEU-1 scores of various models are relatively low and close to each other. We attribute this to the fact that the semantics of possible responses for one query is highly diversified in terms of speaking styles and topics, there might be the situation that only a small portion of words share among the responses except those of high-frequency words mou2016sequence; liu2016not. However, user enhanced models achieve higher BLEU-1 scores due to their capability in considering the preference of a user.