Pre-Trained and Attention-Based Neural Networks for Building Noetic Task-Oriented Dialogue Systems
Table 5: Ablation results for a single model on the validation set of Ubuntu dataset in subtask 2.
['[EMPTY]', 'Recall@1', 'Recall@5', 'Recall@10', 'MRR']
In addition, we ablated the disentanglement strategy and truncated the sequence to the max sequence length of BERT by selecting the head or tail part. The performance drops sharply which shows the effectiveness of the disentanglement strategy.