Utterance-to-Utterance Interactive Matching Network for Multi-Turn Response Selection in Retrieval-Based Chatbots
TABLE VIII: Ablation tests of the context-to-response (C2R) and response-to-context (R2C) representations in the U2U-IMN model on the four datasets.
['Dataset', 'Model', '[BOLD] R10@1', '[BOLD] R10@2', '[BOLD] R10@5']
The bidirectional context-to-response and response-to-context representations in the U2U-IMN model were ablated. Specifically, when the context-to-response representation was ablated, the context representation given by the sentence encoding module {˜Ucm}ncm=1 was sent to the aggregation module directly, and only the response representation {˜Urn}nrn=1 was enhanced by the interactive matching module to obtain {Ur,matn}nrn=1 before aggregation. Similar operations were conducted to ablate the response-to-context representation. We can see that ablation of either the context-to-response or response-to-context representations resulted in a performance degradation, which indicates the effectiveness of the bidirectional matching between contexts and responses in the interactive matching module. A serious performance degradation can be observed when ablating the matching representations of both directions.