Violin: A Large-Scale Dataset for Video-and-Language Inference
Table 6: Accuracy (%) on each statement type in Violin test set. All the methods use BERT feature.
['Statement Reasoning Type', 'Stmt+ Subtt', 'Stmt+Vis Img', 'Stmt+Vis Det', 'Stmt+Subtt+Vis Img', 'Stmt+Subtt+Vis Det']
Accuracy on Different Question Types Compared to Stmt+Subtt, Stmt+Subtt+Vis models improve mostly on “visual recognition” and “action recognition”. For categories such as “inferring reasons” and “identify character”, including video gains some improvement. On “conversation reasoning” and “human dynamics”, adding video features does not help.