When is multitask learning effective? Semantic sequence prediction under varying data conditions
Table 2: Baseline (BL) and best system performance difference (Δ) for all main tasks—improvements in bold, significant improvements underlined—plus number of systems over baseline for each main task.
['[EMPTY]', 'BL', 'ΔBest', 'Description', 'aux layer', '# over']
Given the size of the space of possible task combinations for MTL, we only report the baseline and the results of the best system. The last column indicates the amount of systems that beat the baseline for a given certain main task. Our results confirm that increasing the size of the hidden layers reduces generalization performance. This is the case for all setups. (Frames 0, Mpqa: 2, Ner: 0, SemTraits: 9, Supersenses: 0).