Text-to-Text Pre-Training for Data-to-Text Tasks
Table 4: Results on the ToTTo development set for different variants of T5.
['Model', 'Overall BLEU', 'Overall PARENT', 'Overlap Subset BLEU', 'Overlap Subset PARENT', 'Non-Overlap Subset BLEU', 'Non-Overlap Subset PARENT']
T5-Base, which has roughly the same number of parameters as BERT-to-BERT, shows large improvements. (+3.7 BLEU, +4.5 PARENT). Even T5-Small, which has 3x fewer parameters, performs better than BERT.