Generating Persona Consistent Dialogues by Exploiting Natural Language Inference
Table 4: The results of human evaluation for response quality, together with the Fleiss Kappa (K). The K coefficient between 0.41 and 0.6 means moderate agreement.
['[BOLD] Model', '[BOLD] 0', '[BOLD] 1', '[BOLD] 2', '[BOLD] Avg', 'K']
Our model has the highest ratio of 2, which means our generated responses are of higher quality. The Transformer also performs well in human evaluation, but it gets many 1 points. One reason could be that this model generates more questions rather than declarative sentences, which makes human judges feel less informative.