Crisscrossed Captions: Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
Table 6: Image ↔ Text retrieval performance on MSCOCO 5k test set.
['[BOLD] Model', '[BOLD] Image → Text R@1', '[BOLD] Image → Text R@5', '[BOLD] Image → Text R@10', '[BOLD] Image → Text med r', '[BOLD] Text → Image R@1', '[BOLD] Text → Image R@5', '[BOLD] Text → Image R@10', '[BOLD] Text → Image med r']
New positive items added by CxC annotations show improved retrieval performance as they identify missing positives that are incorrectly penalized when using only original pairs (as noted in \newciteilharco2019large for Flickr8k).