Speech-Based Visual Question Answering
Table 5. Performance on 1000 human-recorded questions.
['[EMPTY]', 'All', 'Y/N', 'Number', 'Other']
Finally, a small, supplementary test is run on non-synthetic, human-recorded questions to see if the models would perform differently on real-world audio inputs. 1000 samples were randomly selected from val, and the best performing models from the ZS section were used for evaluation.