Robustness of Linguistic Features:Syntactic Errors are More Important than Lexical
Table 2: Lexical complexity and richness, and syntactic complexity of the three datasets. Counts for n-grams appearing only once are shown as proportions of the total number of respective n-grams. Highest values on each line are typeset in bold.
['[BOLD] Feature subgroup', '[BOLD] Feature', '[BOLD] DemB', '[BOLD] IMDBs', '[BOLD] AphB']
In terms of lexical and syntactic complexity, it is interesting to note that AphB contains samples that are most lexically complex, while at the same time it is the most simple from the syntactic point of view. We associate this with the fact that AphB data come from partially unstructured tasks, where free speech increases the use of a more complex and more diverse vocabulary. This may be explained by the fact it is the only dataset based on typewritten language.