Emergence of Communication in an Interactive World with Consistent Speakers
Table 1: Test results of task completion performance for tasks with increasing number of colors, numbers and missions (in the referential game we also use shapes). We also provide the vocabulary size and maximum sentence length for each setup.
['[BOLD] Training setup', '[BOLD] Ref-8C/5S', '[BOLD] 3C/1N/1M', '[BOLD] 8C/1N/1M', '[BOLD] 8C/3N/1M', '[BOLD] 3C/3N/2M', '[BOLD] 3C/3N/3M']
Interactive: Our environment with varying numbers of colors, numbers and missions. If a single number is used, it is 1; If a single mission is used, it is Collect; if two missions are used, they are Collect and Paint. As the difficulty of the tasks increases, the performance of PG substantially decreases. PGLowEnt, which is more consistent, outperforms PG but fails on complex tasks. PGFixed, which only trains the utterance generation parameters, does not perform better.