DailyDialog: A Manually Labelled Multi-turn Dialogue Dataset
Table 6: “Equivalence” percentage (%) of retrieval-based approaches.
['[EMPTY]', 'Feature', '+I-Rerank', '+I-E-Rerank']
We also evaluate them by calculating the “Equivalence” percentage between the labels (i.e., intention, emotion) of the retrieved responses and those of the groundtruth responses. Though subtle improvements can be seen when using labels, we speculate it as not a very strong evaluation metric. It is unsafe to conclude that the higher the “equivalence” percentage is, the better (more coherent, more suitable) the retrieved response will be.