Pre-train and Plug-in: Flexible Conditional Text Generation with Variational Auto-Encoders
Table 6: The impact of different β on long text generation task.
['[ITALIC] β', 'Accuracy', 'Distinct-1', 'Distinct-2']
Since β is an important hyper-parameter for PPVAE, we test β∈{0,2,5,10} on the long text generation task. Specifically, when β is too large, more diverse samples could be generated, but the accuracy may be sacrificed slightly. On the contrary, when β is too small, the accuracy could climb to a higher value, but meanwhile, the diversity drops drastically. Empirically, we find that β=5 is an appropriate value for all tasks.