Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs
Table 9: The Generation Quality of Different Outer Hop Concept Selectors. Both Bleu and Nist are used to calculate the relevance between generated responses and golden responses.
['Version', 'Bleu-1', 'Bleu-2', 'Bleu-3', 'Bleu-4', 'Nist-1', 'Nist-2', 'Nist-3', 'Nist-4']
Rand outperforms Base on most evaluation metrics, which illustrates the quality of generated response can be improved with more concepts included. Distract outperforms Rand on all evaluation metrics, which indicates that concepts appearing in golden responses are meaningful and important for the conversation system to generate a more on-topic and informative response. On the other hand, Full outperforms Distract significantly, even though not all golden concepts are included. The better performance thrives from the underlying related concepts selected by our ConceptFlow (select). This experiment further demonstrates the effectiveness of our ConceptFlow to generate a better response.