Flexible End-to-End Dialogue System for Knowledge Grounded Conversation
Table 5: Automatic Evaluation on the QA dataset
['Models', 'BLEU', 'Precision', 'Recall']
MusicQA GenDS improves BLEU score, entity-accuracy and entity-recall significantly compared with S2SA, GenQA and GenQAD. GenQA does not obtain comparable performance with the original QA This may be the due to our mitigation of redundancy for the dataset. Unlike MusicConvers, GenDS-static exhibits decent performance on entity-accuracy and entity-recall. 99% questions in MusicQA only contain one entity in answer. Thus, most of messages do not need dynamic knowledge enquirer to generate multiple entities. However, GenDS still achieves higher entity-accuracy and entity-recall than GenDS-static. This verifies that the proposed dynamic knowledge enquirer is useful even when only one entity is generated.