A new dataset and model for learning to understand navigational instructions
Table 4: The performance (test accuracy) comparison of baselines and the proposed model. Results were obtained using ensemble of three models for each architecture.
['Task', 'L.O.', 'B.O.F.', 'Ours']
The Language Only baseline achieves surprisingly good results on the visual tasks without receiving perceptual information. One reason for this is that some instructions for the visual tasks contain non-perceptual clues to solve the task, e.g. ”turn right to the chair”, ”move forward two steps to the easel”. For example, most of the action sequences are (RIGHT, STOP) in the Orient task.