Fluency-Guided Cross-Lingual Image Captioning
Table 4. Two datasets used in our image captioning experiments. Besides Flickr8k-cn (Li et al., 2016a), we construct Flickr30k-cn, a bilingual version of Flickr30k (Young et al., 2014) obtained by English-to-Chinese machine translation of its train / val sets and human translation of its test set.
['[EMPTY]', '[BOLD] Flickr8k-cn\xa0(Li et\xa0al.,  2016a ) train', '[BOLD] Flickr8k-cn\xa0(Li et\xa0al.,  2016a ) val', '[BOLD] Flickr8k-cn\xa0(Li et\xa0al.,  2016a ) test', '[BOLD] Flickr30k-cn (this work) train', '[BOLD] Flickr30k-cn (this work) val', '[BOLD] Flickr30k-cn (this work) test']
Setup. While we target at learning from machine-translated corpus, manually written sentences are needed to evaluate the effectiveness of the proposed framework. Each test image in Flickr8k-cn is associated with five Chinese sentences, obtained by manually translating the corresponding five English sentences from Flickr8k In addition to Flickr8k-cn, we construct another test set by extending Flickr30k For each image in the Flickr30k training / validation sets, we employ Baidu translation to automatically translate its sentences from English to Chinese. The sentences associated with the test images are manually translated. Notice that an English word might have multiple translations, e.g., football can be translated into ‘足球’(soccer) and ‘橄榄球’(American football). For disambiguation, translators were shown an English sentence together with the image. For the sake of clarity, we use Flickr30k-cn to denote the bilingual version of Flickr30k. Besides the translation of English captions, Flickr8k-cn also contains independent manually written Chinese captions. Main statistics of Flickr8k-cn and Flickr30k-