Universal Word Segmentation: Implementation and Interpretation
Table 6: Accuracy of the seq2seq transducer on Arabic and Hebrew.
['Language', 'Data size Training', 'Data size Validation', 'Evaluation Scores ACC', 'Evaluation Scores MFS']
Word segmentation with full UD processing is notably more challenging for Arabic and Hebrew. ACC is exact match and MFS is based on edit distance. The transducer yields relatively higher scores on Hebrew while it is more challenging to process Arabic.