From Characters to Words to in Between: Do We Capture Morphology?
Table 10: Average perplexities of words that occur after reduplicated words in the test set.
['Model', 'all', 'frequent', 'rare']
In contrast with the overall results, the BPE bi-LSTM model has the worst perplexities, while character bi-LSTM has the best, suggesting that these models are more effective for reduplication.