Utterance Pair Scoring for Noisy Dialogue Data Filtering
Table 2: Samples of utterance–response pairs scored with our method and human judgements (English). The scores of SI and SR were normalized by α, β.
['[EMPTY]', 'Utterance', 'Response', '[ITALIC] S [BOLD] I', '[ITALIC] S [BOLD] R', '[ITALIC] S [BOLD] I+ [BOLD] R', 'Human']
Finally, we provided the score to utterance– This shows the contribution of each element of the scoring function, SI and SR, to a final score, SI+R, which is consistent with human judgments.