Relationship-Embedded Representation Learning for Grounding Referring Expressions
TABLE VI: Experimental results of spatial/semantic relation graph branch on RefCOCO, RefCOCO+ and RefCOCOg.
['[EMPTY]', 'RefCOCO testA', 'RefCOCO testB', 'RefCOCO+ testA', 'RefCOCO+ testB', 'RefCOCOg test']
Effectiveness. We compare the CMRINs with single spatial relation graph branch, with single semantic relation graph branch and joint model including both branches. The performance of single semantic branch is worse than that of single spatial branch, because the object relationship detector cannot recognize the semantic relations completely accurately in the highly unrestricted scenes. In addition, the model including both branches achieves the best precision, which indicate the possibility of cooperation between the spatial and semantic relationship representations.