Discourse Level Factors for Sentence Deletion in Text Simplification
Table 2: Pearson correlation between deletion rate and document length, measured by the number of sentences and tokens respectively.
['[EMPTY]', 'Middle Corr.', 'Middle p-value', 'Elementary Corr.', 'Elementary p-value']
Document length We hypothesize that the length of the original article will impact how much content professional editors choose to compress to reach a certain reading level. The correlations are significant for both middle and elementary levels, yet with the middle level the correlation values are particularly high. Longer documents indeed have higher percentages of sentences being deleted.