Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs
Table 3: Human Evaluation on Appropriate (App.) and Informativeness (Inf.). The Average Score takes the average from human judgments. Best@1 Ratio indicates the fraction of judges consider the case as the best. The number of parameters are also presented.
['Model', 'Parameter', 'Average Score App.', 'Average Score Inf.', 'Best@1 Ratio App.', 'Best@1 Ratio Inf.']
The first is the mean of five judges; the latter calculates the fraction of judges that consider the corresponding response the best among four systems. ConceptFlow outperforms all other models in all scenarios, while only using 30% of parameters compared to GPT-2. This demonstrates the advantage of explicitly modeling conversation flow with structured semantics.