Video Captioning with Guidance of Multimodal Latent Topics
Table 6. The influence of human interactions on Youtube2Text dataset with noisy and clean expert-defined topics assignment.
['[EMPTY]', 'BLEU4', 'METEOR', 'ROUGE [ITALIC] l', 'CIDEr']
Besides the improvement on the caption performance, our topic-guided model can provide an interface for users to be involved in the caption generation. For example, users could simply assign a category tag to the uploaded videos with minimum costs to refine the automatic generated video descriptions. To evaluate the performance boosts with the human enhancement to our topic-guided model, we manually re-annotate the expert-defined topics for Youtub2Text dataset as the clean version and compare its caption performance with the noisy assigned topics.