A Multitask Learning Approach for Diacritic Restoration
Table 1: Number of words and out of vocabulary (OOV) rate for Arabic. OOV rate indicates the percentage of undiacritized words in the test set that have not been observed during training.
['[BOLD] Train', '[BOLD] Test', '[BOLD] Dev', '[BOLD] OOV']
For word based tasks, we segment each sentence into space tokenized words. For character based tasks, we, in addition, add the special boundary “\ ” between these words, and then each word is further segmented into its characters, similar to that in Alqahtani et al. We pass each word through the model along with a specific number of previous and future words (+/- 10 words).