Talk2Nav: Long-Range Vision-and-Language Navigation with Dual Attention and Spatial Memory
Table 4: Comparison of our method to other methods at varying difficulty levels: from short paths consisting of one landmark to long paths consisting of four landmarks. SPL↑ is used as the metric.
['Methods / #(Landmarks)', '1', '2', '3', '4']
In addition to the evaluation for the long-range (i.e. 4-landmark) navigation, we also study the performance of all these trained methods when evaluated at varying difficulty levels: from short navigation paths consisting of one landmark to long ones consisting of four landmarks. We evaluate under SPL and compare our method with the prior works as before. We observe that our method outperforms all the other prior works by a large margin. For instance, our method improves SPL (%) from 72.21 to 74.28 for short routes having 1 landmark, from 37.71 to 43.08 for routes with 2 landmarks, and from 23.16 to 27.96 for routes with 3 landmarks, when compared to ma2019self.