LSTM based Conversation Models
Table 3: The performance of response ranking with Recall@K.
['Metric', 'Baseline', 'R-Conv', 'LDA-Conv', 'R-LDA-Conv']
Both R-Conv and LDA-Conv are better than baseline result, while R-LDA-Conv gives the best performance overall. Both role factors and topic feature are acting positively in ranking ground-truth responses. Even though no role information is explicitly used in the baseline model, the contextual information itself could be a useful hint to rank the ground-truth response higher. Therefore, the performance of the baseline model is still better than random guess. Again, role has a bigger effect than topic, and the combination gives the best results, but differences in Recall@K performance are small.