A Multimodal Dialogue System for Conversational Image Editing
Table 2: Results of our simulated user evaluation. SER denotes semantic error rate. Our DQN policy still retains high success rate even under high semantic errors compared to rule-based baseline.
['SER', 'Rule-based Turn', 'Rule-based Reward', 'Rule-based Goal', 'Rule-based Success', 'DQN Turn', 'DQN Reward', 'DQN Goal', 'DQN Success']
At low SER (<0.2), we can see that rule-based and DQN can successfully complete the dialogue. As SER increases (>0.2), the success rate of the rule-based policy decreases. On the other hand, our DQN policy manages to learn a robust policy even under high SERs and achieved 90% success rate.