Shaping representation through communication: Community size effect in artificial learning systems
Table 1: Encoder identification accuracies.
['[EMPTY]', '[BOLD] Community size 2', '[BOLD] Community size 4', '[BOLD] Community size 8', '[BOLD] Community size 16']
The better than random accuracy indicates that pairwise co-adaptation does indeed occur. Increasing the community size can reduce the degree of co-adaptation, since in MNIST we see accuracy drop to levels close to chance for large communities. However, it does not fully overcome the co-adaptation problem, especially in more diverse datasets such as CIFAR-100.