Unsupervised Evaluation of Interactive Dialog with DialoGPT
Table 4: Performance of each system on the fine-grained qualities. All scores are 1-3, except Understandable and Consistent are 0-1 and Overall is 1-5.
['[BOLD] Quality', '[BOLD] Mitsuku', '[BOLD] Meena', '[BOLD] Human']
For all of the turn-level qualities, Meena outperforms both Mitsuku and Human. The strength of Meena is most noticeable for interesting, engaging and specific.