Neural Word Segmentation with Rich Pretraining
Table 6: Influence of pretraining.
['[BOLD] Pretrain', '[BOLD] P', '[BOLD] R', '[BOLD] F', '[BOLD] ER%']
In particular, by using punctuation information, the F-score increases from 95.86% to 96.25%, with a relative error reduction of 9.4%. This is consistent with the observation of Sun and Xu Finally, by integrating all above information via multi-task learning, the F-score is further improved to 96.48%, with a 15.0% relative error reduction.