Does Multimodality Help Human and Machine for Translation and Image Captioning?
Table 3: BLEU scores for various deep features on the image description generation task using the system of Xu et al. [Xu et al.2015].
['Network', 'BLEU-1', 'BLEU-2', 'BLEU-3', 'BLEU-4']
The results increase during the first layers but stabilize from Block-4 on. Based on these results and considering that a higher spatial resolution is better, we have selected layer ’res4f_relu’ (end of Block-4, after ReLU) for the experiments on multimodal MT. We also compared the features from different networks on the task of image description generation with the system of Xu et al. The results for generating English descriptions Therefore, given the increase in computational cost, we have decided to use ResNet-50 features for our submission.