Text Readability Assessment for Second Language Learners
Table 1: Number of documents in the original and modified WeeBit corpus
['[EMPTY]', 'Level1', 'Level2', 'Level3', 'Level4', 'Level5']
The texts are webpage documents stored in raw HTML format. We have identified that some texts contain broken sentences or extraneous content from the webpages, such as copyright declaration and links, that correlate with the target labels in a way which is likely to artificially boost performance on the task and would not generalize well to other datasets. To avoid that, we re-extracted texts from the raw HTML and discarded text documents that do not contain proper reading passages.