One Model to Recognize Them All:Marginal Distillation from NER Models with Different Tag Sets
Table 4: F1 score results for progressive NER experiments. The best results are in bold.
['System', 'BN', 'BC', 'MZ', 'TC', 'WB', 'AVG']
Collisions rooted from different tag sets still occur during the fine-tuning, resulting in less optimal transfer performance. Among the two Mardi variants, the one with access to unlabeled source data performs better, suggesting in-domain unlabeled data is crucial for effective knowledge distillation.