Text-to-Text Pre-Training for Data-to-Text Tasks
Table 2: Results on WebNLG. † Metrics as reported in Zhao et al. (2020)
['Model', 'BLEU Overall', 'BLEU Seen', 'BLEU Unseen', 'METEOR Overall', 'METEOR Seen', 'METEOR Unseen']
T5-Large performs the best across BLEU as well as METEOR. It and improves over PlanEnc by 4.3 BLEU on the overall test set. It also displays excellent generalization to new domains and relations, with a 14 BLEU improvement on the unseen test set. The results indicate that with pre-training, end-to-end neural models can surpass sophisticated pipelined approaches.