Exploring and Predicting Transferability across NLP Tasks
Table 7: In-class transfer results for classification/regression tasks in full source → full target.
['Task', 'CoLA', 'SST-2', 'MRPC', 'STS-B', 'QQP', 'MNLI', 'QNLI', 'RTE', 'WNLI', 'SNLI', 'SciTail']
In each table, rows denote source tasks while columns denote target tasks. Each cell represents the target task performance of the transferred model from the associated source task to the associated target task. The orange-colored cells along the diagonal indicate the results of fine-tuning BERT on target tasks without any intermediate fine-tuning. Positive transfers are shown in blue and the best results are highlighted in bold (blue). For transfer results in the limited setting, we report the mean and standard deviation across 20 random restarts.