Assessing Discourse Relations in Language Generationfrom Pre-trained Language Models
Table 1: % of sentences with a particular discourse connective, of all sentences that contain a connective.
['[EMPTY]', 'after', 'and', 'because', 'before', 'but', 'if', 'since', 'so', 'though', 'when', 'while']
In the PersonaChat training set, ∼11% of the responses contain one of the connectives. In contrast, the fine-tuned model generates a connective 26% among all responses, and the organic one 15%. The increase in percentage is likely because connectives are frequent words in the corpus. Notably, the distribution of connectives is skewed, with and and but appearing much more often than other connectives, a characteristic similar to other collected examples of discourse relations in the conversation domain Ma et al.