Incremental Transformer with Deliberation Decoder for Document Grounded Conversations
Table 2: The percent(%) of score (0/1/2) of Knowledge Relevance and Context Coherence for Wizard Transformer, ITE+CKAD and ITE+DD.
['[EMPTY]', 'Knowledge', 'Context']
This result also demonstrates that Deliberation Decoder can improve the knowledge correctness and guide the following conversations better. Wizard Transformer has a great performance on Knowledge Relevance only second to our proposed Incremental Transformer. However, its score on Context Coherence is lower than some other baselines. And the poor performance on Context Coherence also shows Wizard Transformer does not respond to the previous utterance well. This shows the limitation of representing context and document knowledge by simple concatenation.