Cross-Lingual Vision-Language Navigation
Table 5: Ablation study for domain adaptation. Reported results are averages of 3 individual runs on Chinese human instructions. meta+txt2img is our model for zero-shot setting. meta+txt2img+domain is to add the domain adaptation loss. The results are SPL values on validation unseen set.
['Training data size (%)', '5', '10', '20', '40', '60', '80', '100']
Adversarial Domain Adaptation Loss To demonstrate the domain adaptation loss indeed enhance knowledge transfer between two languages, we compare it with our vanilla zero-shot model, a meta-learner equipped with a txt2img module. Meanwhile, domain adaptation loss provides a more consistent and steady improvement. At the endpoint (100%), the SPL is 22.14 vs 21.50, proves its efficiency and the potential of transferring knowledge between different languages.