FlowDelta: Modeling Flow Information Gain in Reasoningfor Conversational Machine Comprehension
Table 2: The ablation study of BERT-FlowDelta (%).
['[BOLD] Model', '[BOLD] CoQA F1', '[BOLD] QuAC F1']
It is interesting that the proposed inFlowDelta and exFlowDelta boost the performance more on QuAC. As yatskar2018qualitative mentioned, the topics in a dialogue shift more frequently on QuAC than on CoQA, and we can see vanilla BERT also performs well on CoQA in the ablation of Flow which provides long term dialog history information. Therefore, we can conclude that while FlowDelta improves the ability to grasp information gain in the dialog, it bring less performance improvement in the setting we do not need much contexts to answer the question.