Video Caption Dataset for Describing Human Actions in Japanese
Table 4: Results from the sentence generation task.
['approach', 'modality', 'BLEU', 'ROUGE', 'CIDEr']
The use of two modalities with both sentence-wise and phrase-wise generation performed better than the single modality cases across all criteria, and image modality alone came second.