DMRM: A Dual-channel Multi-hop Reasoning Model for Visual Dialog
Table 3: Ablation study of our proposed model on VisDial val v0.9 [das2017visual]. “DMRM w/ n-hop” means the model use n-hop reasoning. “DMRM w/o AttD” means the model is not use multimodal attention decoder. Note that “DMRM w/ 2-hop” is an incomplete reasoning process under our designed architecture and the ablation study of n-hop reasoning is based on the model “DMRM w/o AttD”.
['Model', 'MRR', 'R@1', 'R@5', 'R@10', 'Mean']
By comparing “DMRM w/ n-hop”, we see the effectiveness of multi-hop reasoning. By comparing “DMRM w/o Locate” and “DMRM w/o Track” with DMRM, we see the effectiveness of our dual-channel models. By comparing our final model DMRM with “DMRM w/o AttD”, we illustrates the improvement due to multimodal attention in the decoder.