Talk the Walk: Navigating Grids in New York City through Grounded Dialogue
Table 8: Localization given last {1, 3, 5} dialogue utterances (including the guide). We observe that (1) performance increases when more utterances are included; and (2) MASC outperforms no-MASC in all cases; and (3) mean ^T increases when more dialogue context is included.
['#utterances', 'MASC', 'Train', 'Valid', 'Test', '[ITALIC] E[ [ITALIC] T]']
We conduct an ablation study for MASC on natural language with varying dialogue context. Specifically, we compare localization accuracy of MASC and no-MASC models trained on the last [1, 3, 5] utterances of the dialogue (including guide utterances). In all cases, MASC outperforms the no-MASC models by several accuracy points. We also observe that mean predicted ^T (over the test set) increases from 1 to 2 when more dialogue context is included.