PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation
Table 2: Test results of answer generation on the official MARCO leaderboard as of December 9, 2019.
['[BOLD] Method', '[BOLD] Rouge-L']
PALM achieves the 1st place on the leaderboard, outperforming all competing methods in generation quality. Note that PALM pre-trains a single model, while some of the top-performing methods are ensemble models, such as Masque, on the leaderboard. Crucially, the superiority of PALM-single over Masque-ensemble with pre-trained ELMo Peters et al.