MMM: Multi-stage Multi-task Learning for Multi-choice Reading Comprehension
Table 8: Ablation study for the RACE dataset. The accuracy is on the development set. All parts of MMM improve this source dataset.
['[BOLD] Settings', '[BOLD] RACE-M', '[BOLD] RACE-H', '[BOLD] RACE']
So far we have been discussing the case where we do multi-task learning with the source dataset RACE and various much smaller target datasets to help improve the targets. We also want to see whether our proposed techniques can also benefit the source dataset itself. From this table, we see that all three techniques can bring in improvements over the baseline model for the source dataset RACE, among which NLI coarse-tuning stage can help elevate the scores most.