Natural Language Processing with Small Feed-Forward Networks
Table 4: Segmentation results. Explicit bigrams are useful.
['[BOLD] Model', '[BOLD] Accuracy', '[BOLD] Size']
Zhang et al. Zhang et al. However, such embeddings could easily lead to a model size explosion and thus are not considered in this work. Our model featuring bigrams runs at 110KB of text per second, or 39k tokens/second.