Resolving Language and Vision Ambiguities Together: Joint Segmentation & Prepositional Attachment Resolution in Captioned Scenes
Table 1: Results on our subset of ABSTRACT-50S.
['Module', 'Stanford Parser', 'Domain Adaptation', 'Ours', 'oracle']
We performed a 10-fold cross-validation on the ABSTRACT-50S dataset to pick M (=10) and the weight on the hinge-loss for Mediator (C). This shows a need for diverse hypotheses and reasoning about visual features when picking a sentence parse. oracle denotes the best achievable performance using these 10 hypotheses.