Modulated Self-attention Convolutional Network for VQA
Table 1: Experiments run on a ResNet-34. Numbers following S (stages) and B (blocks) indicate where SA (self-attention) modules are put. Parameters count concerns only SA and are in millions (M).
['[BOLD] ResNet-34', '[BOLD] Eval set %', '[BOLD] #param']
However, we managed to show improvements with the β modulation with a ResNet-152. Though the improvement is slim, it is encouraging to continue researching into visual modulation