Variational Hierarchical Dialog Autoencoder for Dialog State Tracking Data Augmentation
Table 5: Comparison of user simulation performances.
['Model', 'WoZ2.0 Acc', 'WoZ2.0 Ent', 'DSTC2 Acc', 'DSTC2 Ent']
Although our model is not proposed for the task in mind, we show that, in terms of accurately and creatively simulating users, our model outperforms the previous state-of-the-art (VHUS) (Gür The quality of user simulation is evaluated using the prediction accuracy on the test sets, while the diversity is measured by the entropy of predicted dialog act specifications (act-slot-value triples) with respect to the dialog act distribution of the training set.