AMUSED: A Multi-Stream Vector Representation Method for Use in Natural Dialogue
Table 3: Human based evaluation is conducted for 5 different components in the network as well as KV memory networks. AMUSED achieves the highest percent gain over specified baseline model. The scale is 1-10.
['[BOLD] Model', '[BOLD] Coherence', '[BOLD] Context Aware', '[BOLD] Non Monotonicity', '[BOLD] Average Rating', '[BOLD] %gain']
To monitor the effect of each neural component, we get it rated by experts either in isolation or in conjunction with other components. Such a study helps us understand the impact of different modules on a human based conversation. Dialogue system proposed by Zhang et al.