Dynamic Multi-Level Multi-Task Learning for Sentence Simplification
Table 5: Multi-task layer ablation results on Newsela.
['Models', 'BLEU', 'FKGL', 'SARI']
Sharing Approaches We empirically show that our final multi-level layer sharing method (i.e., higher-level semantic layer sharing with entailment generation, while lower-level lexico-syntactic layer sharing with paraphrase generation) performs better than the following alternative layer sharing methods: (1) both auxiliary tasks with high-level layer sharing, (2) both with low-level layer sharing, and (3) reverse/swapped sharing (i.e., lower-level layer sharing for entailment, and higher-level layer sharing for paraphrasing).