Integrate Image Representation to Text Model on Sentence Level: a Semi-supervised Framework
Table 4: Result on SNLI. Here, * stands for multimodal NLU models.
['[BOLD] Models', '[BOLD] Test']
Integrated NLI Model: In Table we shows the results of integrating the mechanism to language inference model based on BERT. We firstly report the state-of-the-art performance of BERT-large model (91.2%) on the SNLI dataset. Based on the trained BERT-large encoder, we then train the integrated visualization language inference model using three-step training process, and achieve new SOTA performance reported (91.3%) yet on the SNLI dataset. By integrate to pre-trained NLU model, the framework also largely outperforms previous multimodal NLU models.