Learning to Generate Grounded Visual Captions without Localization Supervision
Table 11: Performance comparison on the Flickr30k Entities val set with different weightings on decoding and reconstruction losses. All results are averaged across five runs.
['[EMPTY]', 'Captioning Evaluation', 'Captioning Evaluation', 'Captioning Evaluation', 'Captioning Evaluation', 'Captioning Evaluation', 'Grounding Evaluation', 'Grounding Evaluation', 'Grounding Evaluation', 'Grounding Evaluation']
The weighting between the two losses was chosen with a grid search on the val set. We can see that when comparing to the baseline, all different loss weightings consistently improved both captioning and grounding accuracy.