Multilingual Unsupervised Sentence Simplification
Table 7: Importance of Large Scale Mining. We finetune BART+ACCESS on varying amounts of mining.
['# Training Samples', '[BOLD] ASSET (English) SARI', '[BOLD] ASSET (English) BLEU', '[BOLD] ASSET (English) FKGL']
How Much Mined Data Do You Need? Our proposed method leverages the large quantity of sentences in many languages available on the web to mine millions of paraphrases. We investigate the importance of a scalable mining approach that can create million-sized training corpora for sentence simplification. By increasing the number of mined pairs, SARI drastically improves, indicating that efficient mining at scale is critical to achieve state of the art performance. Unlike human-created training sets, unsupervised mining with LASER and faiss allows for even larger datasets, and enables this for multiple languages.