Tactical Rewind: Self-Correction via Backtrackingin Vision-and-Language Navigation
Table 2: Plug-n-play performance gains achieved by adding Fast to current SoTA models.
['Validation Unseen Speaker-Follower', 'SR (%) 37', 'SR (%)', 'SPL (%) 28', 'SPL (%)', 'TL 15.32']
Another key advantage of our technique is how simple it is to integrate with current approaches to achieve dramatic performance gains. Simply changing their greedy decoders to Fast with no added global information and therefore no reranking yields immediate gains of 6 and 9 points in success rate for Speaker-Follower and SMNA, respectively. Due to those models’ new ability to backtrack, the trajectory lengths increase slightly. However, the success rate increases so much that SPL increases, as well.