Large Scale Multi-Actor Generative Dialog Modeling
Table 5: Comparison of model performance as size varies. All models are trained from a pre-trained checkpoint for 70K iterations with a batch size of 128.
['Model', '[ITALIC] h', '[ITALIC] l', '[ITALIC] A', 'Params', 'PPL']
Finally, we performed an ablation study on the size of GCC-Dec used. All models fine-tuned from a pre-trained checkpoint for 70,000 iterations at a global batch size of 128. As shown in Shoeybi et al. This increase in performance is significant as it has been shown that for conversational models there is a correlation between held-out perplexity measures and human-likeness of sampled turns, especially for models within the same family Adiwardana et al.