VizWiz Grand Challenge: Answering Visual Questions from Blind People
Table 2: We report the number of visual questions filtered in our iterative review process by crowd workers and then in-house domain experts (including with respect to each vulnerability category).
['Filter', '# of VQs']
We attribute the extra thousands of flagged visual questions from domain experts to their better training on the potential vulnerabilities. For example, location information, such as zip codes and menus from local restaurants, when augmented with additional information (e.g., local libraries have lists of blind members in the community) could risk exposing a person’s identity. Also, blurry and/or bright images, when post-processed, could reveal PII. Additionally, people’s faces can appear in reflections on monitor screens, window panes, etc. We do not expect crowd workers to understand such nuances without extensive instructions and training.