Machine Comprehension Based on Learning to Rank
Table 7: Analysis of semantic components of our model. “+”” and “-” refer to added or ablated components. Coref, WMD and FS denotes coreference system, word mover’s distance and frame semantics.
['Models', 'CNN Val', 'CNN Test', 'Daily Mail Val', 'Daily Mail Test']
From the experimental results, we can see that coreference system does not bring improvement to our system, and even harm the performance. This might because the coreference system (Stanford CoNLP) we use in our system cannot have good performance when the sentences are complicated. We can also find from the results that the word embedding and frame semantics components plays a vital role in our system, although the single feature performance of frame semantics is quite low.