Multimodal Machine Translation with Embedding Prediction
Table 3: Ablation experiments of visual features. “− Debias” denotes the result without subtracting the bias vector. “− Images” shows the result of text-only NMT with embedding prediction.
['Model', 'val BLEU', 'test BLEU', 'test METEOR']
The interesting result is that multitask learning with raw images would not help the predictive model. Debiasing images is an essential preprocessing for NMT with embedding prediction to use images effectively in multitask learning scenario.