Low-Rank RNN Adaptation for Context-Aware Language Modeling
Table 4: Perplexity and classification accuracies for the EuroTwitter and GeoTwitter datasets.
['[BOLD] Model', '[BOLD] EuroTwitter PPL', '[BOLD] EuroTwitter ACC', '[BOLD] GeoTwitter PPL', '[BOLD] GeoTwitter ACC']
The FactorCell model has the lowest perplexity and the highest accuracy for both datasets. Again, the FactorCell model clearly improves on the ConcatCell as measured by classification accuracy. Consistent with our hypothesis, adapting the softmax bias is not effective for these small vocabulary character-based tasks. The SoftmaxBias model has small perplexity improvements (<1%) and low classification accuracies.