(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Annotated Stylistic Language Dataset with Multiple Personas
Table 1: Denotation experiment to find the best input setting (i.e., meaning preserved but stylistically diverse). story-level measures the metrics for five sentences as a story, and sentence-level per individual sentence. Note that single reference sentence setting only has sentence level. For every metrics in both meaning preservation and style diversity, the higher the better. The bold number is the highest, and the underlined is the second highest.
['[EMPTY]', '[ITALIC] denotation settings', '[BOLD] Style Diversity E(GM)', '[BOLD] Meaning Preservation METEOR', '[BOLD] Meaning Preservation VectorExtrema']
For the sentence level, as expected, single reference sentence has the highest meaning preservation across all the metrics because it is basically paraphrasing the reference sentence. In general, Story (images + local keywords) shows a great performance with the highest diversity regardless of the levels, as well as the highest preservation at the soft measure on the story-level. Thus, we use Story(images+local keywords) as the input setting for our final data collection, which has the most balanced performance on both metrics.