Learning Paraphrastic Sentence Embeddingsfrom Back-Translated Bitext
Table 9: Differences in entropy and repetition of unigrams/trigrams in references and translations. Negative values indicate translations have a higher value, so references show consistently higher entropies and lower repetition rates.
['Lang.', 'Data', 'Ent. (uni)', 'Ent. (tri)', 'Rep. (uni)', 'Rep. (tri)']
The translated text has lower n-gram entropies and higher rates of repetition. This appears for all datasets, but is strongest for common crawl and French-English 109.