Interactive Visual Grounding of Referring Expressions for Human-Robot Interaction
TABLE I: Grounding accuracy of UMD Refexp and INGRESS on the RefCOCO dataset, with human-annotated ground-truth (HGT) object proposals and automatically generated MCG object proposals.
['Dataset', 'HGT (%) UMD Refexp', 'HGT (%) INGRESS', 'MCG (%) UMD Refexp', 'MCG (%) INGRESS']
S5SS1SSS0Px2 Results The correctness of a grounding result is based on the overlap between the output and the ground-truth image regions. The grounding is deemed correct if the intersection-over-union (IoU) measure between the two region is greater than 0.5. INGRESS adopts a two-stage grounding process in order to reduce the number of relevant object proposals processed in complex scenes. On average, the validation and test sets contain 10.2 ground-truth object proposals and 7.4 MCG object proposals per image. As the number of object proposals per image is small, the two-stage grounding process does not offer significant benefits.