Spatio-Temporal Scene Graphs for Video Dialog
Table 3: Comparison of visual representations against STSGR on AVSD@DSTC7.
['Method', 'Feature', 'B4', 'M', 'R', 'C']
In general, we find that STSGR can answer spatial and temporal questions very well. This is quantitatively evidenced by observing that while both STSGR and MTN [le2019multimodal] use similar backends, they differ in the input representations (I3D in [le2019multimodal] vs. scene graphs in ours), and our model outperforms MTN by a significant baseline (1.265 vs 1.249 on CIDEr), substantiating the importance of our STSGR representation.