Spatio-Temporal Scene Graphs for Video Dialog
Table 2: Comparisons of STSGR against state of the art AVSD test split on DSTC7 and DSTC8 challenges. Acronyms: R=I3D RGB, F=I3D flow, A=VGGish.
['AVSD@DSTC7 Method', 'AVSD@DSTC7 Feature', 'AVSD@DSTC7 BLUE-4', 'AVSD@DSTC7 METEOR', 'AVSD@DSTC7 ROUGE', 'AVSD@DSTC7 CIDEr', 'AVSD@DSTC7 Human']
Comparisons to State-of-the-Art Methods: We also provide the human evaluation rating on the AVSD@DSTC8 test split. As is clear from the results, our approach achieves state-of-the-art performance against all the baselines. We also attempted to include audio into our framework using the VGGish features available with the AVSD dataset. However, we found that these features did not improve the performance, suggesting perhaps we need more powerful audio embeddings, research into which is beyond our current focus.