MTLE: A Multitask Learning Encoder of Visual Feature Representations for Video and Movie Description
Table 2: MSVD Dataset
['Model', 'BLEU', 'METEOR']
These methods were published in the last couple years and are the state of the art in video description in the MSVD dataset. We experimented with different CNN features such as GoogleNet, ResNet and C3D. Overall, ResNet showed the best performance on this and other datasets while C3D performed the worst. In MSVD our MTLE method shows competitive results in the Meteor metric and significant improvements on Bleu, with the best performance advantage over other methods in the latter one, even when using only static ResNet features. Notice also that even when using shallower networks for feature extraction such as GoogleNet, our model MTLE still shows improvement over the baseline.