Assessing Language Proficiency from Eye Movements in Reading
Table 2: Pearson’s r and Mean Absolute Error (MAE) for prediction of MET scores (test set, 57 participants) and TOEFL scores (leave-one-out cross validation, all 53 participants) from eye movement patterns in reading. We consider two baselines which do not use eyetracking information: (1) the average proficiency score in the training set, which yields 4.82 MAE on MET and 8.29 MAE on TOEFL, and (2) the reading speed of the participant.
['[EMPTY]', '[BOLD] MET Fixed', '[BOLD] MET Fixed', '[BOLD] MET Any', '[BOLD] MET Any', '[BOLD] TOEFL Fixed', '[BOLD] TOEFL Fixed', '[BOLD] TOEFL Any', '[BOLD] TOEFL Any']
We consider two baselines; the first is assigning all test set participants with the average score of the training participants. This baseline yields an MAE of 4.82 on MET and 8.29 on TOEFL. The second baseline uses reading speed as the sole feature for prediction. In all cases, our eyetracking based features outperform the average score and reading speed baselines.