An Empirical Study of Multi-Task Learning on BERT for Biomedical Text Mining
Table 3: Test results on biomedical tasks.
['Model', 'ChemProt', 'DDI', 'BC5CDR disease', 'BC5CDR chemical', '[ITALIC] Avg']
In biomedical tasks, we used BlueBERTbiomedical as the baseline because it achieved the best performance on the BLUE benchmark. MT-BlueBERT-Fine-Tunebiomedical created new state-of-the-art results on 2 tasks and pushing the benchmark to 83.6%, which amounts to 2.0% absolute improvement over BlueBERTbiomedical and 2.1% absolute improvement over MT-BlueBERT-Refinementbiomedical. On the DDI task, the model gained the largest improvement by 8.1%.