Video Object Grounding using Semantic Roles in Language Description
Table 5: Ablative study layers and heads of Transformers.
['SPAT', 'Acc', 'VAcc', 'Cons', 'SAcc']
Transformer Ablation: It is interesting to note adding more heads better than adding more layers for object transformer, while in the case of multi-modal transformer both number of heads and number of layers help. Finally, we find that simply adding more layers and heads to the object transformer is insufficient, as a multi-modal transformer with 1 layer and 3 heads performs significantly better than the object transformer with 3 layers and 6 heads.