Large-Scale Multi-Domain Belief Tracking with Knowledge Sharing
Table 2: The overall F1 score and accuracy for the multi-domain dialogues test set.555F1-score is computed by considering all the values in each slot of each domain as positive and the ”none” state of the slot as negative.
['New WOZ (multi-domain)  [BOLD] Model', 'New WOZ (multi-domain)  [BOLD] F1 score', 'New WOZ (multi-domain)  [BOLD] Accuracy %']
To demonstrate the difficulty of the multi-domain belief tracking problem, values of a theoretical baseline that samples the belief state uniformly at random are also presented. Our model gracefully handles such a difficult task. In most of the cases, CNNs demonstrate better performance than Bi-LSTMs. We hypothesize that this comes from the effectiveness of extracting local and position-invariant features, which are crucial for semantic similarities Yin et al.