Parallel Data Augmentation for Formality Style Transfer
Table 4: Results of human evaluation of FST. Scores marked with */† are significantly different from the scores of Original data / NMT-MTL (p<0.05 in significance test).
['Model', 'Formality', 'Fluency', 'Meaning']
We also conduct human evaluation. We compare our baseline model trained with original data, our best performing model and the previous state-of-the-art models (NMT-MTL and GPT-CAT). We randomly sample 300 items and each item includes an input and four outputs that shuffled to anonymize model identities. Two annotators are asked to rate the outputs on a discrete scale of 0 to 2. More details can be found in the appendix.