SemEval-2020 Task 4: Commonsense Validation and Explanation
Table 4: Average Length of different types of sentences of Training/Dev/Test set
['[BOLD] Type of Sentences', '[BOLD] Training Set', '[BOLD] Dev Set', '[BOLD] Test Set']
Average Length. The sentences in the development and test set have shorter lengths than those in the training set. This is because we check the development and test more carefully and more strictly thus remove more long and incomprehensible instances, which lower the average lengths of the dev/test set. The sensical statements and nonsensical statements almost have the same average lengths in the three sets (the differences are equal or smaller than 1% ), which is balanced. However, there is an obvious gap between the correct reasons and confusing reasons in terms of the average lengths (roughly 4% in the training set and 10% in the dev/test set).