Is this Dialogue Coherent? Learning from Dialogue Acts and Entities
Table 4: Average (5 runs) of Accuracy (Acc.), Mean Reciprocal Rank (MRR), Recall at one (R@1) and Normalized Discounted Cumulative Gain (nDCG) for turn coherence rating for models trained using either Internal (IS) or External Swap (ES) on the Switchboard Coherence corpus.
['[EMPTY]', '[BOLD] Train', '[BOLD] Acc.', '[BOLD] MRR', '[BOLD] R@1', '[BOLD] nDCG']
A selection of best performing models for entities, DAs and their combination were tested on the SWBD-Coh dataset. The lowest performing model seems to be the one based solely on entity features (entword + turn), while models combining DA with entities information (entword + DA + turn) are the best performing ones. Additionally, models trained on ES data perform better than those trained on IS across all conditions.