Hierarchical Context Enhanced Multi-Domain Dialogue System for Multi-domain Task Completion
Table 4: Final results of the DSTC-8 Automatic evaluation
['Rank', 'Team Submission ID', 'Success Rate', 'Return', 'Turns', 'Precision', 'Recall', 'F1', 'Book Rate']
, the user simulator randomly generates a user’s goals to test the submitted system and automatically evaluates the performance. By examining the details, the HCEDS obtains significantly improvement in terms of average dialogue return and average turn number, i.e., average dialogue return of 61.56, 102% improvement from baseline, and average 7 turns per dialogue with 93.75% of booking rate are also far advanced than that of baseline.