An Attentional Neural Conversation Model with Improved Specificity
Table 2: Performance for generation.
['Models', 'BLEU', 'IDF']
The baseline is AWI trained with standard cross-entropy in Sec. Using sampling would lead to an appropriate number of infrequent words and therefore an IDF score that is similar to that of the reference responses. Indeed this is observed in ”AWI + sampling” in the table. It has an IDF score of 2.76, close to the IDF score of 2.74 from the training set. However, sampling produces worse BLEU scores, though it has higher IDF score than AWI.