Creating A Neural Pedagogical Agent by Jointly Learning to Review and Assess
Table 5. The relationship attention and tag matching ratio
['Top- [ITALIC] N', 'tag matching ratio (%)']
One attractive feature of our model is interpretability. SantaTOEIC provides explanations for the reason why the questions are recommended. The attention score of two questions sampled from the exhausted sequence depends on the potential question. When potential question 5 is predicted, the order is opposite. Our results clearly show that higher tag matching ratios correspond to higher attention scores over the corresponding questions. Also, we quantitatively evaluate the performance of attention for all responses. We select the top-N questions from the exhausted sequence based on attention scores and compute tag matching ratios between potential questions and the top k questions.