Compositional Generalization in Image Captioning
Table 2: Average results for Recall@5 (R; Eqn. 1), METEOR (M; Denkowski and Lavie, 2014), SPICE (S; Anderson et al., 2016) , CIDEr (C; Vedantam et al., 2015), BLEU (B; Papineni et al., 2002). rr stands for re-ranking after decoding.
['[BOLD] Model', '[BOLD] R', '[BOLD] M', '[BOLD] S', '[BOLD] C', '[BOLD] B']
butr uses the same image features and a decoder architecture as the butd model. Thus, when using the standard beam search decoding method, butr does not improve over butd. However, when using the improved decoding mechanism with re-ranking butr + rr, Recall@5 increases to 13.2. We also observe an improvement in METEOR and SPICE, and a drop in BLEU and CIDEr compared to the other models.