Sparse Text Generation
Table 8: Values of ϵ used for ϵ-perplexity.
['[EMPTY]', 'WikiText-2', 'WikiText-103', 'BookCorpus', 'PersonaChat']
We report the sparsemax score, Jensen-Shannon, and ϵ-perplexity All metrics are computed at the BPE level Sennrich et al. For softmax, with and without decreased temperature, we set ϵ=0.