A Hierarchical Reinforced Sequence Operation Method for Unsupervised Text Style Transfer
Table 5: Human evaluation results. Methods are selected based on automatic evaluation. Style: style polarity; Content: content preservation; Fluency: fluency; Suc: the proportion of successful transfer (refer to §5.2)
['[EMPTY]', '[BOLD] Yelp Fluency', '[BOLD] Yelp Content', '[BOLD] Yelp Style', '[BOLD] Yelp Suc', '[BOLD] Amazon Fluency', '[BOLD] Amazon Content', '[BOLD] Amazon Style', '[BOLD] Amazon Suc']
Shen et al. For each input sentence and corresponding output, each participant is asked to score from 1 to 5 for fluency, content preservation, and style polarity. If a transfer gets scores of 4 or 5 on all three aspects, it is considered as a successful transfer. To lighten the burden on human participants, we compare our proposed method to only four of the previous methods, selected based on their performance in automatic evaluation. Our proposed method achieves the highest fluency and content preservation on Yelp and performs the best on all human evaluation metrics on Amazon.