Investigating Pretrained Language Models for Graph-to-Text Generation
Table 1: Results on AMR-to-text generation for the AMR17 test set. BS, MS and BT stands for BertScore, MoverScore and BLEURT, respectively.
['[BOLD] Model', '[BOLD] BLEU', '[BOLD] METEOR', '[BOLD] chrF++', '[BOLD] BS (F1)', '[BOLD] MS', '[BOLD] BT']
Note that we also report results from models that leverage PLMs. mager2020gpttoo and harkous2020text employ the GPT-2 model in their approaches. Note whereas GPT-2 is a Transformer-based decoder, our approaches employ BART and T5 that follow a Transformer-based encoder-decoder architecture. T5-Large achieves a considerable improvement of 5.48 BLEU and 1.2 METEOR scores over the previous state-of-the-art model that uses GPT2. BART achieves the new state-of-the-art BLEU score of 43.72, 15.9% higher. Note that the semantic metrics follow similar trends.