From Words to Sentences: A Progressive Learning Approach for Zero-resource Machine Translation with Visual Pivots
Table 6: The BLEU4 scores of image caption model and image-pivoted translation model on IAPR-TC12 and Multi30k datasets.
['[EMPTY]', 'IAPR-TC12 I/De-En', 'IAPR-TC12 I/En-De', 'Multi30k I/De-En', 'Multi30k I/En-De']
Firstly, the translation performance is much higher than the image captioning performance. This is mainly because the translation output is more constrained by the input while the caption output is more diverse. So the image caption model directly used in previous image-pivot translation methods might be a main bottleneck. Secondly, the translation performance is proportional to the image captioning performance, which indicates that better image captioning can further improve our zero-resource machine translation.