Understanding and Improving Information Transfer in Multi-Task Learning
Figure 6: Covariance similarity score vs. performance improvements from alignment.
['Task', 'STL Cap.', 'STL Acc.', 'MTL Cap.', 'MTL Acc.']
We measure the similarity score on the trained MTL model. (a) we observe increased accuracy on 13 of 15 task pairs by up to 4.1%; (b) the similarity score increases for all 15 task pairs.