DualVD: An Adaptive Dual Encoding Model for Deep Visual Understanding in Visual Dialogue
Table 3: Ablation study of DualVD on VisDial v1.0.
['Model', 'MRR', 'R@1', 'R@5', 'R@10', 'Mean', 'NDCG']
ObjRep only considers isolated objects and ignores the relational information, which achieves worse performance compared with VisMod. RelRep considers the relationships by introducing relation embedding. However, empirical study indicates that enhancing visual relationships while weakening object appearance is still not sufficient for better performance. VisNoRel fuses the information from both object appearance and neighborhoods without relational semantics, which achieves slight improvement compared to ObjRep. On top of VisNoRel, VisMod moves a step further by aggregating all the neighborhood features with relational information, which achieves the best performance compared to above three models.