Distributional Discrepancy: A Metric for Unconditional Text Generation
Table 3: Distributional discrepancy of generators and classification accuracy on a real corpus. Acc. indicates the classification accuracy. For all of them, the lower the value, the better is the performance.
['Generator', 'Valid Acc.', 'Valid DD', 'Test Acc.', 'Test DD', 'Generator', 'Valid Acc.', 'Valid DD', 'Test Acc.', 'Test DD']
The gold-standard reference order is estimated, and given the architecture of the LM, a larger number of training data results in a better performance. Unlike the experiment on the syntactic data, we cannot obtain a real LM that generates real sentences. We did not compare these 10 generators together.