Augmenting Transformers with KNN-Based Composite Memory for Dialogue
Table 5: Important Features for KNN Search using KIF. Salient conversation features improve performance on both datasets.
['Model', 'Valid F1']
The quality of the KNN search is critical to the performance of KIF modules. As the external knowledge is kept fixed, KIF must be able to align the dialogue context with the knowledge to identify relevant pieces of information. Using only the encoding of the immediate previous utterance can improve results on Wizard of Wikipedia by 7 F1 points, but this is further improved by also leveraging the encoding of context (+1.8 F1) and using the dialogue turn number (+1 F1). These features are available in the datasets, and we leverage them to improve the relatedness of retrieved knowledge.