Text Infilling
Table 3: Automatic and human evaluation results for long content infilling.
['Dataset', 'Metrics', 'Seq2Seq', 'GAN', 'Self-attn']
With the increasing mask rate, the infilling task becomes more open-end, making BLEU score less suitable. We thus use only the test-set perplexity for automatic quantitative evaluation. Consistent with the above experiments, we can see the self-attention model again improves over other comparison methods on both datasets.