VD-BERT: A Unified Vision and Dialog Transformer with BERT
Table 2: Discriminative and generative results of various models on the val split of VisDial v0.9 dataset.
['[BOLD] Model', 'Discriminative Setting MRR↑', 'Discriminative Setting R@1↑', 'Discriminative Setting R@5↑', 'Discriminative Setting R@10↑', 'Discriminative Setting Mean ↓', 'Generative Setting MRR↑', 'Generative Setting R@1↑', 'Generative Setting R@5↑', 'Generative Setting R@10↑', 'Generative Setting Mean ↓']
S5SS1SSS0Px3 Results on VisDial v0.9 val. For comparison, we choose LF, HRE, HREA, MN Das et al. HCIAE Lu et al. Our model continues to yield much better results in the discriminative setting (e.g., 70.04 MRR compared to DVAN’s 66.67) and comparable results with the state of the art in the generative setting (e.g., 55.95 MRR score vs. DVAN’s 55.94). This validates the effectiveness of our VD-BERT in both settings using a unified Transformer architecture. By contrast, VisDial-BERT can only support the discriminative setting.