Sparse and Structured Visual Attention
Table 1: Automatic evaluation of caption generation on MSCOCO and Flickr30k.
['[EMPTY]', 'MSCOCO spice', 'MSCOCO cider', 'MSCOCO rouge [ITALIC] L', 'MSCOCO bleu4', 'MSCOCO meteor', 'MSCOCO rep↓', 'Flickr30k spice', 'Flickr30k cider', 'Flickr30k rouge [ITALIC] L', 'Flickr30k bleu4', 'Flickr30k meteor', 'Flickr30k rep↓']
As can be seen in Table 1, sparsemax and TVMAX achieve better results overall when compared with softmax, indicating that the use of selective attention leads to better captions. [CONTINUE] Moreover, for TVMAX, automatic metrics results are slightly worse than sparsemax but still superior to softmax on MSCOCO and similar on Flickr30k. [CONTINUE] Selective attention mechanisms like sparsemax and especially TVMAX reduce repetition, as measured by the REP metric reported in Table 1.