Improving Conditioning in Context-Aware Sequence to Sequence Models
Table 8: Backward PPL of the question given the generation.
['Model', 'bw PPL', '[ITALIC] Uctx']
First, we note that the multitask model performs better than sequential on both metrics, which is coherent with the findings from [eli5]’s human evaluation of the model outputs, and validates the use of the proposed metrics. Additionally, the difference in Uctx appears to be the more significant of the two, indicating that our method especially improves over multitask in terms of making good use of the context.