PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentation
Table 2: Results of PKUSEG with a model trained on CTB. “All Average” is the average F1 score of all datasets. “OOD Average (Out-of-domain Average)” is the average results of datsets except for CTB.
['CTB8 Training', 'Testing', 'F1']
To show the effect of domain knowledge on segmentation performance, we train a model on CTB8 dataset and report its performance on different datasets. Here we choose CTB8 as an example because CTB8 is a hybrid dataset. Here are results without using vocabularies. We can see that the performance drops obviously on out-of-domain datasets. Since different domain has its unique segmentation standard, it is not suitable to provide one single model for various domain data. The result demonstrates the necessity of fine-grained segmentation toolkits.