KnowIT VQA: Answering Knowledge-Based Questions about Videos
Table 5: Knowledge retrieval module results on test set.
['[BOLD] Method', '[BOLD] R@1', '[BOLD] R@5', '[BOLD] R@10', '[BOLD] R@100', '[BOLD] MR']
We tested different arrangements in the input data: Only Questions: Candidate answers were not used. QA parameter sharing: In the input string, xij, only one answer, ac, at a time was used as xij=[CLS]+qi+aci+[SEP]+wj+[SEP], which means that the same parameters are used for the four candidate answers. QA prior score: Our proposed method based on ordering answers according to their prior score. There was a big gap between Only Questions and the other two methods, indicating that candidate answers contained relevant information to retrieve the correct knowledge. The best results were obtained with our proposed prior scoring method, which showed that using all the candidate answers together provided more context for finding the correct knowledge instance.