CohEval: Benchmarking Coherence Models
Table 10: The average coherence rankings for pre-trained LM generated texts. Lower is better.
['[BOLD] Model', '[BOLD] GPT2-Base', '[BOLD] GPT2-L', '[BOLD] GPT2-XL', '[BOLD] CTRL']
CTRL performs consistently better than GPT-2 in all the rankings except for the ranking produced by UnifiedModel. The rankings of the generated texts seem to improve in general with an increase in the number of LM parameters.