M{}^{3}P: Learning Universal Representations via Multitask Multilingual Multimodal Pre-training
Table 3: Multilingual image-text retrieval results on MILD. The metric is the mean Recall (mR).
['Setting', 'en', 'es', 'fr', 'de', 'it', 'pt', 'zh', 'ja', 'avg']
The first batch of results is based on Q-I pairs without using image contexts. Comparing to the results on Multi30K and MSCOCO, the numbers on MILD are much lower, which shows it is a harder dataset. The second batch of results is based on Q-I-C triples, where each image and its context always appear together as input. Evaluation results show that such context information helps a lot in the image-text retrieval tasks in MILD.