Disentangling Language and Knowledge in Task-Oriented Dialogs
Table 14: Ablation study: impact of hops in BoSsNet encoder
['[EMPTY]', '[BOLD] bAbI Dialog Tasks T1', '[BOLD] bAbI Dialog Tasks T2', '[BOLD] bAbI Dialog Tasks T3', '[BOLD] bAbI Dialog Tasks T4', '[BOLD] bAbI Dialog Tasks T5', '[BOLD] bAbI Dialog Tasks (OOV) T1', '[BOLD] bAbI Dialog Tasks (OOV) T2', '[BOLD] bAbI Dialog Tasks (OOV) T3', '[BOLD] bAbI Dialog Tasks (OOV) T4', '[BOLD] bAbI Dialog Tasks (OOV) T5', '[BOLD] CamRest BLEU', '[BOLD] CamRest Ent. F1']
Multi-hops in encoder helps in bAbI task 3 and 5, as they require inferencing over the KB tuples (sorting restaurants by rating) to recommend a restaurant. We also see substantial improvements on CamRest in both BLEU and entity F1 metric.