MovieQA: Understanding Stories in Movies through Question-Answering
Table 4: The question-answering accuracy for the “Hasty Student” who tries to answer questions without looking at the story.
['[BOLD] Answer length', '[EMPTY]', 'longest', 'shortest', 'different']
Notably, always choosing the longest answer performs better (25.3%) than random (20%). We see that the answer most similar to others is likely to be correct when the representations are generic and try to capture the semantics of the sentence (Word2Vec, SkipThoughts). The most distinct answers performs worse than random on all features. Especially, TF-IDF performs worse than random since words in the question rarely appear in the answer.