Talk the Walk: Navigating Grids in New York City through Grounded Dialogue
Figure 5: Map of New York City with red rectangles indicating the captured neighborhoods of the Talk The Walk dataset.
['Neighborhood', '#success', '#failed', '#disconnects']
Most parts of the city are grid-like and uniform, which makes it well-suited for obtaining a 2D grid. For Talk For each neighborhood, we choose an approximately 5x5 grid and capture a 360 view on all four corners of each intersection, leading to a grid-size of roughly 10x10 per neighborhood. The Talk Turkers successfully completed 76.74% of all finished tasks (we use this statistic as the human success rate). More than six hundred participants successfully completed at least one Talk The Walk HIT. The Walk dialogs are significantly longer. On average, Turkers needed more than 62 acts (i.e utterances and actions) before they successfully completed the task, whereas Visual Dialog requires 20 acts. The majority of acts comprise the tourist’s actions, with on average more than 44 actions per dialogue. The guide produces roughly 9 utterances per dialogue, slightly more than the tourist’s 8 utterances. Turkers use diverse discourse, with a vocabulary size of more than 10K (calculated over all successful dialogues). The dataset is available at https://github.com/facebookresearch/talkthewalk.