DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehension
Table 7: Comparison of the quality of dialogues from DREAM and Friends (a TV show).
['[BOLD] Metric', '[BOLD] DREAM', '[BOLD] Friends']
Dialogues in DREAM are generally clean and mostly error-free since they are carefully designed by educational experts. However, it is not guaranteed that each dialogue is written or proofread by a native speaker. Besides, dialogues tend to be more proper and less informal for exam purposes. Ma et al. Based on the evaluated instances, articles and verb forms are the two most frequent grammar error categories (10 and 8, respectively, out of 23) in DREAM. Besides, the language tends to be less precise in DREAM, indicated by the number of vocabulary suggestions. For example, experts tend to use expressions such as “really hot”, “really beautiful”, “very bad”, and “very important” instead of more appropriate yet more advanced adjectives that might hinder reading comprehension of learners with smaller vocabularies. According to the explanations provided by the tool, the readability scores for both datasets fall into the same category “Your text is very simple and easy to read, likely to be understood by an average 5th-grader (age 10)”.