NUBIA: NeUral Based Interchangeability Assessor for Text Generation
Table 1: Kendall’s Tau Correlation with human judgment on Flickr 8K dataset. The scores marked with * are taken directly from the original SPICE paper. The BLEU-4 score in the original paper was 0.14 but the experiment was repeated with a smoothed function and the new result is reported.
['[EMPTY]', '[BOLD] Flickr 8K']
Here we observe that NUBIA outperforms all existing methods and achieves state of the art correlation with human judgment of caption quality.