How to Fine-Tune BERT for Text Classification?
Table 7: Test error rates (%) with multi-task fine-tuning.
['Method', 'IMDb', 'Yelp P.', 'AG', 'DBP']
However, multi-task fine-tuning does not seem to be helpful to BERT-CDPT in Yelp P. and AG. Multi-task fine-tuning and cross-domain pre-training may be alternative methods since the BERT-CDPT model already contains rich domain-specific information, and multi-task learning may not be necessary to improve generalization on related text classification sub-tasks.