Meshed-Memory Transformer for Image Captioning
Table 4: Leaderboard of various methods on the online MS-COCO test server.
['[EMPTY]', 'BLEU-1 c5', 'BLEU-1 c40', 'BLEU-2 c5', 'BLEU-2 c40', 'BLEU-3 c5', 'BLEU-3 c40', 'BLEU-4 c5', 'BLEU-4 c40', 'METEOR c5', 'METEOR c40', 'ROUGE c5', 'ROUGE c40', 'CIDEr c5', 'CIDEr c40']
Online Evaluation. In this case, we use the ensemble of four models previously described, trained on the “Karpathy” training split. The evaluation is done on the COCO test split, for which ground-truth annotations are not publicly available. For fairness of comparison, they also used an ensemble configuration. As it can be seen, our method surpasses the current state of the art on all metrics, achieving an advancement of 1.4 CIDEr points with respect to the best performer.