On Evaluating and Comparing Open Domain Dialog Systems
Table 4: Unified Metric - User Ratings Correlation
['[EMPTY]', 'User Ratings', 'Frequent-User Ratings']
As mentioned in Section 4.2-4.7, it is important to unify the evaluation metrics mentioned above to be able to compare conversational performance in totality. We found the correlation between the scores obtained by unified metric with user ratings and Frequent-User ratings.