Sparse Text Generation
Table 5: Automatic evaluation of dialogue generation on the Persona-Chat validation set.
['[EMPTY]', 'sp', 'JS', '[ITALIC] ϵ-ppl', 'F1', 'dist-1', 'dist-2']
Automatic Metrics Results. Entmax again outperforms all the other sampling methods in sparsemax score and ϵ-perplexity, having the lowest JS (same as top-k). Entmax also leads to fewer repetitions, having higher distinct-1 and distinct-2 scores. However, its F1 score is lower (similar findings have been reported in Li et al. . This can be due to dialogue generation being an open-ended generation task that can have multiple correct answers.