Lightweight Adaptive Mixture of Neural and N-gram Language Models
Table 4: Validation perplexity (lower is better) for different features and architectures of the gating model. Each experiment is an average over 10 runs.
['model', 'feature set SIMPLE', 'feature set FULL']
While extra features decrease the perplexity, the effect of the model architecture is much more impactful. On the following, we only consider the LSTM architecture for the gating model.