Factorized Multimodal Transformer for Multimodal Sequential Learning
Table 6: Multimodal sentiment analysis experiments with different number of MTL layers. The number in the square bracket indicates the number of MTL layers.
['[ITALIC] Model \\ [ITALIC] Metric', '[ITALIC] MAE', '[ITALIC] Corr']
We study the effect of number of MTL on FMT performance. The best performance is achieved using 8 MTL layers (which was also the maximum layers we tried in our hyperparameter search).