An Attentional Neural Conversation Model with Improved Specificity
Table 1: Results on the test set.
['Models', 'BLEU', 'Perplexity']
For comparison, BLEU and perplexity scores from an unconditional N-gram model are also reported, which are much worse than those from neural network based models. The BLEU score for n-gram was obtained by sampling from the n-gram and comparing the sampled response to a typical response. Its response has BLEU score of 0.08 if using BLEU with 1-gram. Because it cannot be matched in 4 gram with the typical response, its BLEU with 4 gram is 0. On one experiment, not shown in the table due to space limitation, with smaller training set, we observed these models performed worse yet similarly. This suggests that the benefit of incorporating hierarchical structure in both HRED and AWI is more apparent with larger training data.